Xiaoxu Gao – Medium

Xiaoxu Gao

10.9K Followers

Xiaoxu Gao
in
Towards Data Science

How to Design a Batch Processing

Understand batch processing from business and technical perspective

10 min readJan 10, 2024

--

7

How to Design a Batch Processing

--

7

Xiaoxu Gao
in
Towards Data Science

Demystify Data Backfilling

Let’s talk about data engineers’ nightmare

10 min readNov 20, 2023

--

2

Demystify Data Backfilling

--

2

Xiaoxu Gao
in
Towards Data Science

How to Streamline Communication in Data Pipelines Using Mage

Let the bot handle difficult communications for us

6 min readJul 13, 2023

--

2

How to Streamline Communication in Data Pipelines Using Mage

--

2

Xiaoxu Gao
in
Towards Data Science

Implement Behaviour Driven Development in data pipelines using Mage

Maximize the quality and productivity of your data pipelines

7 min readJul 6, 2023

--

2

Implement Behaviour Driven Development in data pipelines using Mage

--

2

Xiaoxu Gao
in
Towards Data Science

How to Create Valuable Data Tests

What matters is not the quantity, but the quality.

9 min readJul 3, 2023

--

2

How to Create Valuable Data Tests

--

2

Xiaoxu Gao
in
Towards Data Science

How to Build an On-Call Culture in a Data Engineering Team

Systematically resolve data issues in production

9 min readMar 15, 2023

--

6

How to Build an On-Call Culture in a Data Engineering Team

--

6

Xiaoxu Gao
in
Towards Data Science

FinOps: Four Ways to Reduce Your BigQuery Storage Cost

Don’t overlook the cloud storage cost

9 min readJan 30, 2023

--

8

FinOps: Four Ways to Reduce Your BigQuery Storage Cost

--

8

Xiaoxu Gao
in
Towards Data Science

Status Page for Data Products — We All Need One

Effectively communicate with data users

9 min readDec 27, 2022

--

3

Status Page for Data Products — We All Need One

--

3

Xiaoxu Gao
in
Towards Data Science

Understand Columnar and Row-Based Database

An important step before choosing the database

5 min readOct 28, 2022

--

Understand Columnar and Row-Based Database

--

Xiaoxu Gao
in
Towards Data Science

What Data Engineers Can Learn from Software Engineers, and Vice Versa

Don’t be limited by your job description

8 min readOct 25, 2022

--

3

What Data Engineers Can Learn from Software Engineers, and Vice Versa

--

3

Xiaoxu Gao

Xiaoxu Gao

10.9K Followers

I’m a Developer with a focus on Python and Data Engineering. I write stuff to talk to myself and the world. You can find me on linkedin.com/in/xiaoxugao/.

Following

Help
Status
About
Careers
Press
Blog
Privacy
Terms
Text to speech
Teams