Apache Kafka — Introduction & Basic Commands

Anand Prakash
Analytics Vidhya
Published in
7 min readNov 10, 2021

--

Photo by Jeff DeWitt on Unsplash

In this blog post I will cover some of the basics of Apache Kafka and few useful commands to keep handy.

· Introduction
· Basic Commands
Create Kafka topics with Partitions
Deleting Kafka topics
Listing Kafka topics
Describe Kafka topics
Data within each Kafka Partitions
Kafka Topics Settings
Modify Kafka Topics Settings
Get Kafka Topic Partition Offset
Kafka Consumer
Delete Records from Kafka Topic
Performance Test

Introduction

Apache Kafka is an open-source distributed event streaming platform. It allows you to decouple your source system and target system. It is optimized for ingesting and processing streaming data in real-time. Due to its distributed nature, it provides high throughput, scalability, resilient architecture and fault tolerance. Producers can publish and consumers can subscribe to streams of records.

Few use-cases of Apache Kafka are:

  1. Events/Messaging system
  2. Application logs…

--

--

Anand Prakash
Analytics Vidhya

Avid learner of technology solutions around Machine Learning, Big-Data, Databases. 5x AWS Certified | 5x Oracle Certified.