In our journey to optimize our ES Index’s performance, we encountered intermittent CPU spikes caused by high ingestion and search rates on a specific node. We aimed to implement throttling per node’s ingestion rate to tackle this challenge. However, we faced the hurdle of obtaining the Shard ID from the…

In today’s business landscape, managing infrastructure costs plays a vital role in enhancing profitability for large software companies. With the market’s increasing emphasis on profits over growth, it becomes imperative to optimize expenses associated with the company’s infrastructure. …

Reading books has always been difficult for me. Like for any other habit, I have forced myself to read books for months wishing I’ll eventually be able to like reading books, but unfortunately it hasn’t happened yet. It is not that I don't like books, It's just that it always…

Setting up a Kafka cluster for a production environment is no trivial task. There are so many configurations, settings, and decisions to be taken that it’s quite difficult to understand all of them up front. …

In most simple words, Page caching is a mechanism used by Linux Kernal wherein instead of writing/reading directly from a secondary disk, it transparently reads and writes to and from the unused portions of RAM and thereby improving performance and decreasing the number of much slower disk IO operations. Amount of RAM currently used as page cache is indicated by the cache/buff column of the free -m command.