The Code Shelf
Published in

The Code Shelf

DATA

Setting up a “Hello World” app in Airflow using Docker Compose

So, yesterday I tried to set up Airflow for a pet project.

My project basically needed Airflow to run a job every 5 mins to pull data from various sources, transform the data perhaps and write to an Elasticsearch index.

I wanted to dockerize it, so I can deploy the entire the set up easily in any…

--

--

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store