the JVM . . . brought our minimum memory requirements . . . to 1GB of RAM.
It seems like you’re doing java wrong.
I couldn’t easily find my own comment because of medium’s byzantine ui. Here’s the relevant part:
We have a 512mb heap java application handling 3,000 requests/sec with median response time= 0.4ms and p95 response time = 1.1ms. And this one is not some simple hello-world application. It uses memory-mapped files, reads/writes to cassandra, writes to kafka, writes to influxdb, etc.
This application isn’t even using all 512mb it’s allowed to use.