Chris Hronek | Data ConsultantStreamlining ETL Workflows with Apache Airflow and AirbyteDiscover the seamless integration of Apache Airflow and Airbyte for efficient ETL, enhancing scalability and maintainability in data…6 min read·10 hours ago----
jana_omKeep Your Airflow Variables and Connections Safe with GCP Secret Manager🔐Google Cloud Secret Manager is a robust tool within the Google Cloud Platform (GCP) that facilitates the secure storage, management, and…8 min read·May 7, 2024----
Fabio BarbazzaAirflow DAGs must-haveCreate standardized Airflow DAGs based on a pre-defined set of parameters.2 min read·Apr 24, 2024----
Kenny PeetersData-Aware Orchestration with Apache Airflow DatasetsExploration5 min read·Apr 19, 2024----
Mauricio AndersonOrchestrating the Training of Online ML Models with Airflow at X3MBuild ML Model Training Pipelines with Airflow: Strategies for Efficiency and Scalability6 min read·Apr 17, 2024----
Tom StarkData Aware Scheduling: A Case Study of Custom InkBy: Tom Stark, Michael Peteuil6 min read·Apr 10, 2024----
Jed CunninghamApache Airflow 2.9.0: Dataset and UI ImprovementsI’m happy to announce that Apache Airflow 2.9.0 has been released! This time around we have new features for data-aware scheduling and a…6 min read·Apr 9, 2024----
Rio Dwi Putra PerkasaUtilizing DockerOperator in Airflow to Run Containerized Applications in Data Engineer ProjectsBackground12 min read·Apr 2, 2024----
Abhishek SharmaRefining Airflow Logs: Maximizing Insights with Logstash IntegrationAirflow can be configured to read task logs from Elasticsearch and optionally write logs to stdout in standard or json format. These logs…3 min read·Mar 28, 2024----
David BlainOptimizing Integration with the MS Graph API and Power BI with the MSGraphAsyncOperator in AirflowInfrabel orchestrates a myriad of workflows, leveraging Apache Airflow as a pivotal tool for task scheduling and management.11 min read·Mar 15, 2024----