Chris Hronek | Data ConsultantStreamlining ETL Workflows with Apache Airflow and AirbyteDiscover the seamless integration of Apache Airflow and Airbyte for efficient ETL, enhancing scalability and maintainability in data…6 min read·May 28, 2024----
Alexandre Magno Lima MartinsHow we orchestrate 2000+ DBT models in Apache AirflowIn recent years, DBT (Data Build Tool) has established itself as the go-to data transformation workflow, connecting to a variety of…13 min read·May 26, 2024--7--7
jana_omKeep Your Airflow Variables and Connections Safe with GCP Secret Manager🔐Google Cloud Secret Manager is a robust tool within the Google Cloud Platform (GCP) that facilitates the secure storage, management, and…8 min read·May 7, 2024----
Fabio BarbazzaAirflow DAGs must-haveCreate standardized Airflow DAGs based on a pre-defined set of parameters.2 min read·Apr 24, 2024----
Kenny PeetersData-Aware Orchestration with Apache Airflow DatasetsExploration5 min read·Apr 19, 2024----
Mauricio AndersonOrchestrating the Training of Online ML Models with Airflow at X3MBuild ML Model Training Pipelines with Airflow: Strategies for Efficiency and Scalability6 min read·Apr 17, 2024----
Tom StarkData Aware Scheduling: A Case Study of Custom InkBy: Tom Stark, Michael Peteuil6 min read·Apr 10, 2024----
Jed CunninghamApache Airflow 2.9.0: Dataset and UI ImprovementsI’m happy to announce that Apache Airflow 2.9.0 has been released! This time around we have new features for data-aware scheduling and a…6 min read·Apr 9, 2024----
Rio Dwi Putra PerkasaUtilizing DockerOperator in Airflow to Run Containerized Applications in Data Engineer ProjectsBackground12 min read·Apr 2, 2024----
Abhishek SharmaRefining Airflow Logs: Maximizing Insights with Logstash IntegrationAirflow can be configured to read task logs from Elasticsearch and optionally write logs to stdout in standard or json format. These logs…3 min read·Mar 28, 2024----