MQTT and Kafka

How to combine two complementary technologies

Image by analogicus from Pixabay.

MQTT and Kafka are completely different technologies made for different purposes. In most cases, it makes sense to choose only one of the two technologies for your implementation — whichever makes more sense for the requirements of your use case. However, in some scenarios, it is reasonable to combine them both.

In this story, we will…

• give a brief introduction on both MQTT and Kafka (chapter 1)
• describe use cases where a combination of both technologies makes sense (chapter 1)
• describe five different options on how to connect MQTT and Kafka (chapter 2)
• implement two options of connecting MQTT with Kafka (chapter 3)

If you prefer watching over reading, you can find this article also on YouTube.

(1) Introduction

MQTT

MQTT is a widely used ISO standard (ISO/IEC PRF 20922) client-server messaging protocol. The protocol is lightweight and…