PinnedMihir SamantinTowards DevHow to Send Failure Notifications and Files on Slack using AirflowIn this post I will be helping you to set up your DAG Failure notification and how you can send files using Apache Airflow and Slack…May 25May 25
PinnedMihir SamantinTowards DevWhat is DAG?DAG stands for Directed Acyclic Graphs which is one of the core component of the Apache Airflow.Apr 26Apr 26
Mihir SamantHow to cleanup logs collected by Apache AirflowAs you progress through your data journey with Apache Airflow, you’ll likely encounter this scenario. Suppose your DAG is scheduled to run…Jul 31Jul 31
Mihir SamantinApache AirflowAirflow + Bank of Canada API for daily foreign exchange ratesHi everyone! Last month, I created a small ETL project based on Spotify and Airflow for newcomers to the data world. This month, I am…Jul 2Jul 2
Mihir SamantinApache AirflowBuilding ETL pipeline with Airflow + SpotifyCreating ETL pipeline is always a challenge specially when you are diving into Data world for the first time. Here I present you simple and…Jun 21Jun 21
Mihir SamantHow to Create a Spotify App and Generate Auth Keys and Tokens for API ConsumptionIn this blog post, I will guide you through the process of creating a Spotify app and generating the necessary authentication keys and…Jun 2Jun 2
Mihir SamantWhat are Trigger Rules in Airflow?Triggers are indeed pivotal in the Airflow environment, constituting one of the easiest yet crucial components to comprehend. Before…May 8May 8
Mihir SamantHow to deal with different time-zones in AirflowMany encounter this scenario, including myself, where managing various Airflow DAGs across different timezones is essential for serving…Apr 26Apr 26