Bayu SetiawanBuilding an End-to-End Data Lakehouse with Medalion Architecture, Airflow, and DuckDBI hope you are all in good health. I would like to share how to build an end-to-end data lakehouse with Medalion architecture, Airflow, and…1d ago
InApache AirflowbyAlexandre Magno Lima MartinsHow we orchestrate 2000+ DBT models in Apache AirflowIn recent years, DBT (Data Build Tool) has established itself as the go-to data transformation workflow, connecting to a variety of…May 2614
InApache AirflowbyAlexandre Magno Lima MartinsWhat we learned after running Airflow on Kubernetes for 2 yearsApache Airflow is one of the most important components in our Data Platform, used by different teams inside the business. It powers all of…Feb 621Feb 621
Kavyajeet BoraReal-Time Weather Visualization: Orchestrating Geospatial Data Pipeline with Apache AirflowIntroduction1h ago1h ago
InMaking Plum 🛠️byGiorgos Myrianthousdbt + Airflow = ❤Building dbt-airflow: A Python package that integrates dbt and AirflowApr 169Apr 169
Bayu SetiawanBuilding an End-to-End Data Lakehouse with Medalion Architecture, Airflow, and DuckDBI hope you are all in good health. I would like to share how to build an end-to-end data lakehouse with Medalion architecture, Airflow, and…1d ago
InApache AirflowbyAlexandre Magno Lima MartinsHow we orchestrate 2000+ DBT models in Apache AirflowIn recent years, DBT (Data Build Tool) has established itself as the go-to data transformation workflow, connecting to a variety of…May 2614
InApache AirflowbyAlexandre Magno Lima MartinsWhat we learned after running Airflow on Kubernetes for 2 yearsApache Airflow is one of the most important components in our Data Platform, used by different teams inside the business. It powers all of…Feb 621
Kavyajeet BoraReal-Time Weather Visualization: Orchestrating Geospatial Data Pipeline with Apache AirflowIntroduction1h ago
InMaking Plum 🛠️byGiorgos Myrianthousdbt + Airflow = ❤Building dbt-airflow: A Python package that integrates dbt and AirflowApr 169
InTowards Data EngineeringbyCeyhun AkarEnd-to-End Realtime Streaming Data Engineering Project using Python, Docker, Airflow, Spark, Kafka…In the world of data engineering, real-time data pipelines are crucial for processing and analyzing streaming data. In this article, we’ll…Jul 253
JBartiAirflow 3.0 promises us REAL event driven schedulingThis new feature is a great step towards the modernization of Airflow that has kept to its roots of time-based scheduling for so long.1d ago
InData Engineer ThingsbyVolker JanzExploring StarCraft 2 data with Airflow, DuckDB and StreamlitExample on how to create an Airflow DAG to fetch data from the StarCraft II API, utilize DuckDB for processing and Streamlit for…Mar 163
