Unboxing Apache Airflow 3.0: What’s New, What’s Gone, and Why It Matters

A Comprehensive Deep Dive on Airflow 3.0

Photo Generated By Fotor

Finally, Apache Airflow 3.0 has arrived! The Apache Airflow community dropped a release note on April 22nd for this big release.

I wrote a blog post 2 months ago as a preview, Apache Airflow 3.0 Is Coming Soon: Here’s What You Can Expect. I am excited to unbox this updated Apache Airflow and write an updated review about it.

Apache Airflow 3.0 Setup

Apache Airflow has completed comprehensive updates to all the necessary documentation. To avoid the complexity of Python versions, we will use the Docker composer and set up everything quickly.

The official Airflow Docker setup has already been updated to 3.0; we just need to run the following command to fetch the latest yaml file for the composer

curl -LfO 'https://airflow.apache.org/docs/apache-airflow/3.0.0/docker-compose.yaml'

Afterward, you can adhere to the documentation to establish the necessary folders for plugins, DAGs, logs, and configuration. Subsequently, it would be necessary to initialize the database for the Apache Airflow backend (please be advised that Airflow also provides a migration script for 2.x versions).