Intro to Kafka

I’ve recently started reading The Definitive Guide to Kafka. Here are my diagrams covering the first couple chapters of the book. It provides a general overview as well as details on producers and consumers.

*Note that partition assignment by default is managed by the org.apache.kafka.clients.consumer.RangeAssignor class, not the round robin

Please feel free to offer corrections if I misinterpreted things. More to come!

*A great suggestion from one of the readers was to also note that committed offsets, which used to be stored in Zookeeper, are now stored in an internal topic in Kafka that is also replicated. Thank you for your suggestion!