PinnedDorian TeffoinDataDrivenInvestorHow to automate AWS Glue Jobs with Airflow?Imagine having data stored in an S3 bucket, possibly ingested using Airbyte, Fivetran, or a custom Python script deployed on AWS Lambda…May 81May 81
PinnedDorian TeffoinDataDrivenInvestorBuild a Lakehouse Architecture on AWS Using Delta Lake and AWS GlueIn my recent blog post titled “How I Built this Data Platform in One Week,” I utilized Snowflake as the primary source of truth.Apr 10Apr 10
PinnedDorian TeffoinDataDrivenInvestorHow I Built This Data Platform in One WeekThis will certainly be my longest project (so please like and comment), as well as my longest blog post. But whatever… it was a great one…Mar 2218Mar 2218
PinnedDorian TeffoinDataDrivenInvestorFreelance Data Engineering Roadmap+Project ideasWe are in 2024, and you want to become a successful Data Engineer and Freelancer. You are at the right place!Jan 2617Jan 2617
Dorian TeffoinDataDrivenInvestorImplement CI/CD in your Data Engineering Project : it is mandatoryImplementing a CI/CD process is mandatory for any data project. Why? I will break it down in this article and also give you a (dummy)…Mar 9Mar 9
Dorian TeffoinDataDrivenInvestorThe Ultimate Data Engineering Project to Land Your Dream Job in 2024!Dec 30, 20233Dec 30, 20233
Dorian TeffoinDataDrivenInvestorThe Power of Data Warehousing: Unlocking Insights for Your BusinessData is the lifeblood of modern organizations, driving critical decisions and providing insights into business operations. However, as data…Sep 21, 2023Sep 21, 2023
Dorian TeffoinDataDrivenInvestorThe Art of Data Orchestration: Uniting Data for Better InsightsIn today’s data-driven world, businesses of all sizes are amassing vast amounts of information. From customer interactions to operational…Sep 6, 2023Sep 6, 2023
Dorian TeffoinDataDrivenInvestorBig Data Fundamentals for Data Engineers: A Comprehensive OverviewIn today’s data-driven world, the influx of information from various sources has given rise to the era of big data. Data engineers are at…Aug 29, 2023Aug 29, 2023