Ayyoub MaulanainData Engineer ThingsDeveloping Multi Nodes Hadoop, Spark Cluster, and Airflow in Docker Compose (Part 3)Apache Airflow is the de facto standard of workflow orchestrationFeb 14Feb 14
Ayyoub MaulanainData Engineering IndonesiaProgrammatically Managed Airbyte using TerraformAirbyte is an open-source data pipeline platform that serves as an alternative to Stitch Data and Fivetran. Though existing data pipeline…Dec 18, 20231Dec 18, 20231
Ayyoub MaulanainData Engineer ThingsDeveloping Multi Nodes Hadoop, Spark Cluster, and Airflow in Docker Compose (Part 2)First thing first, I will say thank you that you stay tuned to this series of articles that talk about Hadoop, Spark, and Airflow. For…Nov 26, 20231Nov 26, 20231
Ayyoub MaulanainData Engineering IndonesiaApache Airflow Dynamic Task Mapping: Tricks That Distinguish Seniors from JuniorsRemember this article that explains Apache Airflow DAG Factory? In this article We will learn the same tool, I’m a fan of Apache Airflow…Sep 28, 20231Sep 28, 20231
Ayyoub MaulanainData Engineering IndonesiaHow to Build Your Own Apache Airflow DAG FactoryThis DAG Factory will utilize yaml file to define a code based on configuration, it will hide the complex logic behind itJul 9, 2023Jul 9, 2023
Ayyoub MaulanainData Engineering IndonesiaHow to Contribute to Data Engineering Indonesia PublicationWhat’s Data Engineering IndonesiaJun 21, 2023Jun 21, 2023
Ayyoub MaulanainData Engineer ThingsDeveloping Multi Nodes Hadoop, Spark Cluster, and Airflow in Docker Compose (Part 1)IntroductionMar 19, 2023Mar 19, 2023