From mono (lithic) SQL to Python-based microservices
This is the tale of an awesome data engineering team migrating a monolithic SQL to python based microservice
In these two-part posts written by our very own Pini Faran you will find-
Part 1 β How a group of data engineers with amazing DevOps people created a whole new data-streaming pipeline
Part 2 β This Will reveal some (very) subtle issues we tackled along the data enrichment in our streaming data pipeline and how we fixed them. It involves handling complex calculations, data coming out of order \ at random times π, and even coming exactly at the same time π
We are very happy to see that your posts were published and encourage you all to give them a read.