Sign in

Author’s comment: If you want to know why we did this, you can take a look at Building our Tower of Babel: Django + Singer ETL + Airflow for all audiences. This text is 100% technical.

If you’ve arrived here, chances are you already know about Django, Singer ETL and Apache Airflow and how we wanted to find a way to make them work together. In this text you’ll find the solution that we put forward in the hope that it will be useful to someone else. …

Author’s comment: this text was created for all audiences to tell our experience. If you’re a developer, you might be interested in reading Django + Singer ETL + Airflow: blood, sweat and Docker.
However, there’s a tag,
[dev-interest], present throughout the text in those technical details as an explanation of certain details. If they are not of interest to you, you can skip them and it should not affect your reading.

According to one Bible passage, all human beings used a unique language and tried to build a tower, known as the Tower of Babel, to get to heaven. God…


Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store