Kafka : Ordering Guarantees

Partitions

Unique Partition Ordering

Physically topics are split into partitions. A partition lives on a physical node and persists the messages it receives.

Internal Retry Process

Kafka has an internal retry process :

Many Partitions ordering

Having one partition is cool (and sometimes depending of your business mandatory), but you will be obliged to have only one consumer, and the producer throughput will be limited. Thanks to the kafka system of key/partitions, you can create a more intelligent structure, that will allow you to have many partitions and continue having ordered messages.

--

--

Lead engineer at Mindgeek

Love podcasts or audiobooks? Learn on the go with our new app.

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store