3 days agoBuilding a Data Pipeline with Riot Games API and AWS: Gathering and Ingesting DataUnlocking the Power of Gaming Data: A Journey from the Fields of Justice to the Clouds of AWS Hey there, fellow data nerds and League of Legends enthusiasts! So, you’ve ever wondered what kind of stories the massive piles of gaming data are hiding? …AWS20 min readAWS20 min read
Dec 19, 2021Running a spark job using spark on k8s operatorIn the last article, I showed how to set up Apache Airflow on Kubernetes using a helm chart. …Spark7 min readSpark7 min read
Published inDev Genius·Dec 10, 2021Setting up Apache Airflow on Kubernetes with GitSyncWhen I first started studying data engineering I felt overwhelmed by the number of tools and techniques that were required to run data pipelines. …Airflow8 min readAirflow8 min read
