Homepage
Open in app
Sign in
Get started
Making Sense of Data & Helping Others Grow: Tips, Advice, and Stories from the Front Lines of Data Engineering
MOST READ
WRITE FOR US
FEATURED ARTICLE
LinkedIn
Follow
Essential Questions to Master Your Azure Data Engineer Career
Essential Questions to Master Your Azure Data Engineer Career
Want to ace it as an Azure Data Engineer? Discover key SQL, Python, Spark, and Azure questions answered in simple, digestible steps to…
Rui Carvalho
Dec 8
How to Stay Sane and Productive in Data Engineering
How to Stay Sane and Productive in Data Engineering
Smarter Habits for Data Engineers
Tim Webster
Dec 8
5 Important Takeaways After 2 Years in Consulting
5 Important Takeaways After 2 Years in Consulting
Key Takeaways from My Two Years in Consulting
Lorena Gongang
Dec 3
Why Simplicity Wins in Data Engineering (and How to Get There)
Why Simplicity Wins in Data Engineering (and How to Get There)
Stop Over Complicating Everything
Tim Webster
Nov 26
Prepare Like a Pro: 22 Essential SQL Interview Questions and Answers PART -4
Prepare Like a Pro: 22 Essential SQL Interview Questions and Answer...
Welcome to Part 4 of our 22 Essential SQL Interview Questions and Answers series. If you missed Part 1,2 and 3, you can check it out…
Arpita Mishra
Nov 18
Is Traditional Data Warehouse Dead?
Is Traditional Data Warehouse Dead?
We do not just build data warehouses anymore
Waqas Arshad Qadri
Nov 15
Your Data Pipeline is Useless if You Ignore Data Quality.
Your Data Pipeline is Useless if You Ignore Data Quality.
Here’s why
Lorena Gongang
Nov 10
What I learned so far in my Data Engineering career
What I learned so far in my Data Engineering career
Key Insights for Aspiring Data Engineers
Lorena Gongang
Nov 6
Delta Live Tables for Data Quality: Automate and Enforce Standards
Delta Live Tables for Data Quality: Automate and Enforce Standards
Learn how Delta Live Tables can elevate data quality in your pipelines.
Rui Carvalho
Nov 5
Data Engineering with a ‘Cover and Move’ Approach to Data Quality
Data Engineering with a ‘Cover and Move’ Approach to Data Quality
A Tactical Approach to Data Quality
Tim Webster
Nov 5
DLT tutorial part II
DLT tutorial part II
Understanding the core concepts and the API source
Jordi Puig
Nov 4
6 Core Lessons for Data Engineers (No Fluff)
6 Core Lessons for Data Engineers (No Fluff)
Skills You Need (And Ones You Don’t)
Tim Webster
Oct 29
Building Your Data Engineering Foundation: The Power of Passive Preparation
Building Your Data Engineering Foundation: The Power of Passive Pre...
Cultivating Skills That Make a Difference — Without the Rush
Santosh Joshi
Oct 26
How I Passed My GCP Professional Data Engineer Certification in 2024 (Q4)
How I Passed My GCP Professional Data Engineer Certification in 202...
Lessons, resources, and strategies I used to nail the GCP Professional Data Engineer exam in 2024.
Tim Webster
Oct 20
Understanding Programming Paradigms in Data Engineering: A Concise Guide
Understanding Programming Paradigms in Data Engineering: A Concise ...
A Quick Review of the Programming Paradigms We Learned as Students
Santosh Joshi
Oct 19
How to Automate AWS Glue collect stats to boost Athena Query Performance by ~50X
How to Automate AWS Glue collect stats to boost Athena Query Perfor...
Strategy to Automate Stats collection using AWS Lambda
Pavan Emani
Oct 16
Prepare Like a Pro: 22 Essential SQL Interview Questions and Answers PART -3
Prepare Like a Pro: 22 Essential SQL Interview Questions and Answer...
Welcome to Part 3 of our 22 Essential SQL Interview Questions and Answers series. If you missed Part 1 and 2, you can check it out Prepare…
Arpita Mishra
Oct 16
HMS Vs. UC — A Quick Architectural Comparison
HMS Vs. UC — A Quick Architectural Comparison
A Quick Architectural Comparison of Hive Metastore and Unity Catalog in Databricks
Santosh Joshi
Oct 14
Managed Vs External Tables In Azure Databricks
Managed Vs External Tables In Azure Databricks
A Quick Guide To Understand Clear Difference Between Databricks Managed And External Tables
Santosh Joshi
Oct 13
Data Governance: What Every Data Engineer Needs to Know
Data Governance: What Every Data Engineer Needs to Know
This Article Explains What Is Data Governance In Simple Terms
Santosh Joshi
Oct 12
Notes From A Data Engineers Journal
Notes From A Data Engineers Journal
Lessons Learned from a Career in Data Engineering
Tim Webster
Oct 12
5 Tricks on How to Write a Good Poetry
5 Tricks on How to Write a Good Poetry
Do this instead of pip install
Dudhraj Sandeep
Oct 7
A Quick Guide to DevOps Scripting for Data Engineers
A Quick Guide to DevOps Scripting for Data Engineers
Understanding the Building Blocks of DevOps Automation
Santosh Joshi
Oct 7
A Beginner’s Guide to Serialization
A Beginner’s Guide to Serialization
Serialization Clearly Explained
Santosh Joshi
Oct 5
Your Pipeline Will Fail, But Here’s How Data Engineers Handle It
Your Pipeline Will Fail, But Here’s How Data Engineers Handle It
Why Every Data Engineer Needs to Plan for Failure
Tim Webster
Oct 4
About Art of Data Engineering
Latest Stories
Archive
About Medium
Terms
Privacy
Teams
