Kafka on Docker
As Every Apache Kafka user has most definitely gone through, the setting up part of any Kafka infrastructure, is extremely painful and complicated.
In some cases, maybe even worth giving up, now obviously, if you are setting up a Kafka server on a remote machine, it may be worth the hassle, but for most developers, for testing purposes, this can be really painful.
To solve this, we are once again greeted with an old friend, Docker; a containerization Daemon so powerful you would think it’s a VM.
With the Power of the Docker Engine combined with the docker-compose utility, we can fashion a well-composed yml file that has all that we require to set up a Kafka environment with not one but three distinct Kafka servers, running on a singular zookeeper service and nice little kafdrop UI to make things easier, all it takes is one command
docker-compose up
and Voila!, you now have an amazing Kafka setup with almost zero hassle.