Arthur CesarinoBuilding a Data Pipeline with Riot Games API and AWS: Gathering and Ingesting DataUnlocking the Power of Gaming Data: A Journey from the Fields of Justice to the Clouds of AWSMay 25, 2023May 25, 2023
Arthur CesarinoRunning a spark job using spark on k8s operatorIn the last article, I showed how to set up Apache Airflow on Kubernetes using a helm chart. Now it’s time to show you how to run a spark…Dec 19, 2021Dec 19, 2021
Arthur CesarinoinDev GeniusSetting up Apache Airflow on Kubernetes with GitSyncWhen I first started studying data engineering I felt overwhelmed by the number of tools and techniques that were required to run data…Dec 10, 20213Dec 10, 20213