Image for post
Image for post
Photo by JJ Ying on Unsplash

This is the first story of a series of hands on training to teach a bit about Airflow and it intent to explain how to struct a project to have a local environment setup for dockers (using CeleryExecutor) and considering steps to have the service account from a GCP project prepared to be used in your dags.

We are using an existent docker image (see git project) built by myself containing Airflow 1.10.10 with Python 3.7 and setting up to be possible to use Role-based access control (RBAC) interface.

Have Fun!

Information and Prerequisites

  • Basic knowledge in bash commands
  • Basic knowledge in python
  • Installed…

About

Jonatas Junior

Experienced Data Engineer | Passionate About Data | Endless Curiosity | Tireless Student

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store