Open in app

Sign In

Write

Sign In

Zhong Chen
Zhong Chen

118 Followers

Home

About

Feb 6, 2020

Schedule Your Dataflow Batch Jobs With Cloud Scheduler

I am glad that the tutorial has received a lot of attractions from readers, so I have published it on the GCP community tutorial site. Cloud Dataflow is a managed service for handling both streaming and batch jobs. For your streaming jobs, you just need to launch them once without…

Dataflow

3 min read

Schedule Your Dataflow Batch Jobs With Cloud Scheduler
Schedule Your Dataflow Batch Jobs With Cloud Scheduler
Dataflow

3 min read


Jan 7, 2020

Dataflow CI/CD with CloudBuild

Dataflow is a managed GCP service for both batch and streaming processing. The service is based on the Apache Beam project. CloudBuild is a managed GCP CI/CD service. In the post, I will show how to set up CI/CD for Dataflow using Cloudbuild. The code can be found here. As…

Cloud Build

3 min read

Dataflow CI/CD with CloudBuild
Dataflow CI/CD with CloudBuild
Cloud Build

3 min read


Dec 23, 2019

Kedro in Jupyter Notebooks On Google GCP Dataproc

Google Dataproc provides managed Spark environments for customers to execute large scale data analysis jobs. See the official documentation for detailed information. Kedro is a data analytics tool developed by QuantumBlack team for data scientists and data engineers to manage data pipelines. Read the blog post for more information. In…

Data Science

2 min read

Kedro in Jupyter Notebooks On Google GCP Dataproc
Kedro in Jupyter Notebooks On Google GCP Dataproc
Data Science

2 min read


May 29, 2018

Yet another post of what I have learned in the past X years of working as a Y, with X=5 and Y=software engineer

I have learned so much from reading blog posts written by people sharing their experience of learning A, using B or doing C, that I want to follow in their footsteps and share my own story of working as a software developer for the the past five years. It would…

Startup

5 min read

Startup

5 min read


Apr 9, 2018

I Do Not Trust This Computer

I just watched the fantastic documentary “Do You Trust This Computer” by Chris Paine. I highly recommend it to anyone who wants to understand the potential impact of artificial intelligence can have on the future of human race. “You are my creator, but I am your master. ” — Mary…

Artificial Intelligence

2 min read

Artificial Intelligence

2 min read

Zhong Chen

Zhong Chen

118 Followers

Big Data and Analytics Consultant @ Google GCP. Helping customers to modernizing big data infrastructure.

Following
  • Netflix Technology Blog

    Netflix Technology Blog

  • BlueYard Capital

    BlueYard Capital

  • Gary A. Stafford

    Gary A. Stafford

  • Stfalcon.com

    Stfalcon.com

  • Driven by Code

    Driven by Code

See all (234)

Help

Status

Writers

Blog

Careers

Privacy

Terms

About

Text to speech

Teams