Boning Zhang – Medium

Boning Zhang

Boning Zhang
in
Towards Data Science

A Python implementation of concurrent consumers for Google Cloud Platform Pub/Sub

An example shows how to publish messages to Pub/Sub and build a service to consume the messages concurrently

May 31, 2020

A Python implementation of concurrent consumers for Google Cloud Platform Pub/Sub

May 31, 2020

Boning Zhang

A proactive monitoring/alerting system for ETL data pipelines using table dependency graph and…

In this blog, we will build a monitoring system for ELT data pipelines which can visualize table dependency and send alerts for failed…

Feb 18, 2020

A proactive monitoring/alerting system for ETL data pipelines using table dependency graph and…

Feb 18, 2020

Boning Zhang
in
Analytics Vidhya

An Airflow Sub-Dag to Sync Data from On-Premise Hadoop Cluster to Google Cloud Storage

We are now in the process of data migrating from on-premise Hadoop cluster to Google Cloud Platform (GCP). Since there are a lot of data…

Feb 3, 2020

Feb 3, 2020

Boning Zhang
in
Analytics Vidhya

Google Cloud Platform User Manual for Big Data Projects

This blog was originally for our team’s internal use, introducing the architectures of our Google Cloud Platform (GCP) projects, our best…

Feb 2, 2020

Google Cloud Platform User Manual for Big Data Projects

Feb 2, 2020

Boning Zhang
in
Towards Data Science

A Python API for Background Requests Based on Flask and Multi-Processing

First things first, let me briefly explain what API is and what it can help us. Simply speaking, API is a program running in a host and…

Dec 9, 2019

A Python API for Background Requests Based on Flask and Multi-Processing

Dec 9, 2019

Boning Zhang
in
Analytics Vidhya

A python solution to run query in Google Cloud Dataproc using API and return back query results

This post can also be found in Big Data Daily. See Git for source code.

Nov 24, 2019

Nov 24, 2019

Boning Zhang
in
Analytics Vidhya

An Airflow sensor for stamp files in Google Cloud Storage

This blog was originally posted in Big Data Daily.

Nov 14, 2019

Nov 14, 2019

Boning Zhang

Boning Zhang

Software Engineer @WalmartLabs, interested in big-data techniques, data visualization, machine learning, etc. https://www.linkedin.com/in/boning-zhang-937b1775

Following

Help
Status
About
Careers
Press
Blog
Privacy
Terms
Text to speech
Teams