Xiaoxu GaoinTowards Data ScienceHow to Design a Batch ProcessingUnderstand batch processing from business and technical perspectiveJan 107Jan 107
Xiaoxu GaoinTowards Data ScienceDemystify Data BackfillingLet’s talk about data engineers’ nightmareNov 20, 20232Nov 20, 20232
Xiaoxu GaoinTowards Data ScienceHow to Streamline Communication in Data Pipelines Using MageLet the bot handle difficult communications for usJul 13, 20232Jul 13, 20232
Xiaoxu GaoinTowards Data ScienceImplement Behaviour Driven Development in data pipelines using MageMaximize the quality and productivity of your data pipelinesJul 6, 20232Jul 6, 20232
Xiaoxu GaoinTowards Data ScienceHow to Create Valuable Data TestsWhat matters is not the quantity, but the quality.Jul 3, 20232Jul 3, 20232
Xiaoxu GaoinTowards Data ScienceHow to Build an On-Call Culture in a Data Engineering TeamSystematically resolve data issues in productionMar 15, 20236Mar 15, 20236
Xiaoxu GaoinTowards Data ScienceFinOps: Four Ways to Reduce Your BigQuery Storage CostDon’t overlook the cloud storage costJan 30, 20238Jan 30, 20238
Xiaoxu GaoinTowards Data ScienceStatus Page for Data Products — We All Need OneEffectively communicate with data usersDec 27, 20223Dec 27, 20223
Xiaoxu GaoinTowards Data ScienceUnderstand Columnar and Row-Based DatabaseAn important step before choosing the databaseOct 28, 2022Oct 28, 2022
Xiaoxu GaoinTowards Data ScienceWhat Data Engineers Can Learn from Software Engineers, and Vice VersaDon’t be limited by your job descriptionOct 25, 20223Oct 25, 20223