PinnedKafka Basics and Producer Configs (Part 1)Data is the most precious thing that drives most new things we develop. Everything we do becomes a data source as we navigate to applications, and click for some actions, logs, and user metrics(health metrics). All this data needs to be handled in the best manner to become a potential…Distributed Systems8 min readDistributed Systems8 min read
Published inDev Genius·PinnedPostgres Storage OptimizationHow to optimize the storage of the Postgres database that can ultimately help in optimizing queries contributing to overall database performance? Most of the time we keep on adding storage to our Postgres Heap when storage seems full as adding storage is cheap. Is this right way to handle increasing…Postgres7 min readPostgres7 min read
Published inDev Genius·Jul 30Kafka Consumer and Offsets Commit Strategy(Part 2)Kafka Consumers provides a way to subscribe and process the events that are sent to Kafka Broker by producers. Consumer Group: A consumer Group is a collection of consumers that will subscribe to the same topic or group of topics. In normal scenarios, we generally create a consumer and subscribe…Kafka8 min readKafka8 min read
Published inDev Genius·Sep 15, 2022Postgres IndexingLet’s start with why Indexing then we will move to what is Indexing. When we store the tables on Postgres they are stored in the Postgres heap. They are actually stored as physical files in a database. When we fetch records from a file they are searched sequentially from page(or…Postgres8 min readPostgres8 min read
Jul 9, 2020Why Data Migration? How to Quickly Implement using JavaScript?As we all know, Data is growing at a rapid rate with ever increasing features and end users. Sometimes we need to migrate/replicate this huge set of data across multiple databases. Below are the few cases when we may need to do data migration activity: Data becomes Unmanageable with the…5 min read5 min read
Jul 8, 2020System Design: Low Latency Localization ServiceI was working with one ECommerce Client a few years back. They were supporting Web Version as well as native apps (Android, IOS). Currently, a decent amount of traffic/hits is coming to their application on a regular basis. …Localization4 min readLocalization4 min read
Jul 8, 2020System Design: Book My Show / Online Booking DesignBook My Show is one of the biggest platforms for booking shows/movies/events. Book My Show is currently operating in 5 countries(650 cities) and serving around 30 million customers. In most ticket booking platforms like BookMyShow, Make My Trip and other platforms, when we select a ticket. Selected tickets are blocked…System Design Interview5 min readSystem Design Interview5 min read
Jul 7, 2020System Design: Netflix Design in DetailNetflix is one most successful Video Streaming Platform. Started back in 1997 in America, Netflix is now available and widely used across 190+ countries. According to wikipedia, Netflix has around 170 million paid members in 2019. When Netflix originally started, it used DVD’s for content. …System Design Interview7 min readSystem Design Interview7 min read
Jun 30, 2020System Design: URL ShortenerNow a days we generally get payment links, invitations and promotional links via sms/mails. Links for all these are generally very small and when we open that link we usually see the redirection to a long url in browsers. Let me share some sms: In the above screenshot we got…System Design Interview4 min readSystem Design Interview4 min read
Jun 30, 2020System Design: API Rate Limiter DesignHave you seen when we execute external system’s api multiple times (with or without subscription), sometimes we get quota exhausted for today/hour? Initial requests respond properly. This is due to a limited Quota available for users in some time defined range. …Rate Limiting5 min readRate Limiting5 min read