Highlighted by shiva kiran
From How Pinterest runs Kafka at scale by Pinterest Engineering
…quired to handle broker failures. That added significant operational overhead to the team. In 2017, we built and open-sourced DoctorKafka, a Kafka operations automation service to perform partition reassignment during broker failure for o…
From How Pinterest runs Kafka at scale by Pinterest Engineering
…rokers are in the us-east-1 region. We have a smaller footprints in us-east-2 and eu-west-1. We use MirrorMaker to transport data among these three regions. In each region, we spread the brokers among multiple clusters for topic level isolation. With that…