BlaBlaCar
Published in

BlaBlaCar

Streaming Data out of the Monolith: Building a Highly Reliable CDC Stack

Introduction

CDC and Debezium

A simple architecture of a CDC stack with debezium MySQL connector

High Availability

Deduplication architecture

CDC stack with deduplicator for high availability

Deduplicator key-value store

Exactly-once

Example code of “exactly once” with kafka transaction
CDC stack with 2 debezium connectors. Duplicated messages are filtered out by the deduplicator and the overall service behaves as only one single CDC stream.

Monitoring

Performance

Operations

Conclusion

--

--

BlaBlaCar is the go-to marketplace for shared mobility, combining short and long-distance carpooling and buses. In building the future of mobility, we set ourselves high and ambitious targets and bring tech and data to the heart of our product experience and strategy.

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store