Understand Kafka’s storage architecture

Photo by David Pupaza on Unsplash

Introduction

Kafka Storage Architecture is designed to handle a high throughput of data and provide scalability and fault tolerance. Kafka uses a log-structured storage architecture. Data is stored in partitions, which are stored on disk as sequential files, known as logs. Each partition is replicated to multiple servers to provide fault tolerance. Kafka also uses a log compaction…