Published inData Engineer ThingsDebugging like a Champ — PythonHello friends! Happy New Year! Yes, I know it's August, but I have been MIA since last year 🙈, so it's still happy new year to me.Aug 30Aug 30
Published inData Engineer ThingsI completed a Senior Data Engineer Code Challenge for fun, and this is how it went. PART IIQuestion: Using MySQL’s public employee sample database, create a DAG to move data from the employee’s table to BigQuery.Apr 27, 2024A response icon5Apr 27, 2024A response icon5
On Learning... Continuous LearningHello friends, I am not sure I have said Happy New Year, so Happy New Year, Friends 🥳! I hope the year is going according to plan and you…Mar 9, 2024A response icon3Mar 9, 2024A response icon3
Published inData Engineer ThingsI completed a Senior Data Engineer Code Challenge for fun, and this is how it went.Question: Using MySQL's public employee sample database, create a DAG to move data from the employee's table to BigQuery. There should also…Mar 2, 2024A response icon10Mar 2, 2024A response icon10
Published inArt of Data EngineeringWriting PySpark Integration Tests with ChispaThis past week, I was tasked with writing an integration test for several PySpark jobs. Before now, I had only created unit tests, so this…Nov 4, 2023Nov 4, 2023
On Staying ConsistentHello! Long time no article!Sep 16, 2023A response icon5Sep 16, 2023A response icon5
Published inData Engineer ThingsMigrating Data From MongoDB to Azure SQL Server with Azure Data FactoryWhy do we need to move data?Aug 5, 2023A response icon2Aug 5, 2023A response icon2
Published inGoPenAIPandas for Data Engineers — Part 1IntroductionJun 17, 2023A response icon2Jun 17, 2023A response icon2
Published inTowards Data EngineeringData Warehouse vs Data LakeI have been a data engineer for over four years and have mostly worked with data warehouses. Recently I started working with a data lake…May 6, 2023May 6, 2023
