Nitish GoyalManaging Elasticsearch at scale at PhonePe — Part 2In the previous article, I talked briefly about the architecture of our Elasticsearch and various strategies we have used to scale out…Jun 11Jun 11
Nitish GoyalThe Kafka Edge : Managing 100 Billion Daily Events at PhonePeIn the dynamic landscape of modern technology, data-driven decision-making is pivotal to an organization’s success. At PhonePe, this…May 30May 30
Nitish GoyalManaging Elasticsearch at scale at PhonePe — Part 1Real time analytics platform at PhonePe handles more than 100 billion events a day. We store this data for approximately 30 days which is…May 30May 30
Nitish GoyalKafka replication using Mirror Maker 2.0 (MM2)This document outlines the strategy to replicate Kafka across DCs. We are using Kafka MM2 for cross cluster replication (CCR)Apr 11, 20202Apr 11, 20202
Nitish GoyalImprove elasticsearch performance by blocking queries based on cardinalityThis story is about blocking elasticsearch queries for fields with high cardinalityAug 22, 2018Aug 22, 2018
Nitish GoyalMigrate elasticsearch cluster from 2.x to 6.xThis is a story of how we migrated elasticsearch cluster from 2.4 to 6.3 in just 2 weeks. There is no rolling upgrade available from 2.x to…Aug 20, 2018Aug 20, 2018