Apache Airflow for Data Science — How to Migrate Airflow Metadata DB to Postgres and Enable Parallel Execution

Apache Airflow doesn’t run tasks in parallel by default — but there’s an easy fix

Photo by Martin Sanchez on Unsplash

Apache Airflow allows you to manage complex data pipelines and run tasks in parallel — even distributed among many nodes — but not by default…