written by Megha Desai , Software Engineer — ML/AI at Searce. Originally published at Searce Engineering blog

As part of building an enterprise DW for one of our customers we had to sync a bunch of tables from a MYSQL slave to BigQuery at 30 min intervals. Considering the range of other non-relational data sources which will be part of the this…