Apache Kafka Best Practices

Harsha Chintalapani
May 2, 2018 · 7 min read

Java Version

OS Settings

Disks And File System

Log Flush Management

FileSystem Selection

Zookeeper

Choosing Topic/Partitions

Factors Affecting Performance

Kafka Broker configs

Kafka Producer:

Critical Configs

Performance Notes

Lifecycle of a request from Producer to Broker

Compression.type

Max.in.flight.requests.per.connection

Kafka Consumer:

Performance Notes:

Streaming

A blog about all things streaming and related technologies…

Welcome to a place where words matter. On Medium, smart voices and original ideas take center stage - with no ads in sight. Watch

Follow all the topics you care about, and we’ll deliver the best stories for you to your homepage and inbox. Explore

Get unlimited access to the best stories on Medium — and support writers while you’re at it. Just $5/month. Upgrade

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store