Kafka Deployment using AWS
In scope of MoleCare application design and development and my master project, I made a research how to use Kafka in AWS and built a system for running DNN service, which integrated to MoleCare backend application using Kafka.
In scope of work
- Kafka can be available on the Internet if the ports are configured. That is why I setup VPC and I configure users and groups for allowing Kafka keeping data on the filesystem.
- Also, I create two topics in Kafka. One topic is for request with mole images, and another one is the queue of prediction results.
Steps
- Launch instance
- SSH client setup
- Install Kafka
- Set zookeeper properties
- Run zookeeper
- Run Kafka
- Create topics