Homepage
Open in app
Sign in
Get started
Making Sense of Data & Helping Others Grow: Tips, Advice, and Stories from the Front Lines of Data Engineering
MOST READ
WRITE FOR US
FEATURED ARTICLE
LinkedIn
Follow
Mastering Architecture Diagrams and Technical Presentations: A Data Architect’s Guide
Mastering Architecture Diagrams and Technical Presentations: A Data Architect’s Guide
How to create impactful technical presentations and diagrams that effectively communicate complex ideas with precision and storytelling
Pavan Emani
Sep 19
Working with APIs: Building Data Pipelines Using Python Requests Library
Working with APIs: Building Data Pipelines Using Python Requests Li...
Beginner’s Guide to Interacting with APIs and Building Efficient Data Pipelines Using Python and Requests Library
Satyam Sahu
Sep 19
Top Cloud Services That Every Data Engineer Should Know
Top Cloud Services That Every Data Engineer Should Know
Must-Know Cloud Services for Data Engineers
Lorena Gongang
Sep 17
A Cool SQL Feature Most Of The Data Professional Don’t Know
A Cool SQL Feature Most Of The Data Professional Don’t Know
How Qualify Clause Can Make Your SQL Code More Elegant
Santosh Joshi
Sep 17
Data Engineering 101 : A Glossary of Confusing Terms Explained
Data Engineering 101 : A Glossary of Confusing Terms Explained
Clarifying Buzzwords to Improve Your Data Engineering Knowledge
Santosh Joshi
Sep 16
Building Your First ETL Pipeline with Python and SQL
Building Your First ETL Pipeline with Python and SQL
Step-by-Step ETL Pipeline Tutorial - Learn How to Extract, Transform, and Load Data Using Python and SQL for Beginners
Satyam Sahu
Sep 16
Advanced Data Engineering Interview Questions-Part 4
Advanced Data Engineering Interview Questions-Part 4
Welcome to Part 4 of our Advanced Data Engineering Interview Questions series.
Arpita Mishra
Sep 15
Data Engineering Success Starts with One Simple Habit — Organization
Data Engineering Success Starts with One Simple Habit — Organization
Key lessons for improving efficiency and staying organized.
Tim Webster
Sep 15
SQL Query Optimization Best Practices
SQL Query Optimization Best Practices
Writing Clean, Efficient, and Readable SQL Queries for Faster Performance
Satyam Sahu
Sep 15
I Spent Hours Unraveling Database Sharding — Here’s What I Discovered
I Spent Hours Unraveling Database Sharding — Here’s What I Discovered
Database Sharding: How to Boost Performance by Splitting the Load
RAKESH CHANDA
Sep 15
Building Production-Grade Data Pipelines: Key Characteristics
Building Production-Grade Data Pipelines: Key Characteristics
Crafting Scalable, Fault-Tolerant Data Pipelines Using Modern Data Engineering Tools and Frameworks
Santosh Joshi
Sep 14
Handling Large Datasets in SQL
Handling Large Datasets in SQL
Techniques for Querying Millions of Rows Efficiently
Satyam Sahu
Sep 14
Why Data Engineers Need to Understand DevOps
Why Data Engineers Need to Understand DevOps
Learn why adopting DevOps is essential for faster deployments, better data quality, and scalable systems.
Rui Carvalho
Sep 13
Visual Studio Code VS Databricks Notebooks : A Detailed Comparison
Visual Studio Code VS Databricks Notebooks : A Detailed Comparison
Finding the Right Fit for Your Data Engineering Team’s Development Needs
Santosh Joshi
Sep 13
Is it time for Pandas to give up its data analytics crown?
Is it time for Pandas to give up its data analytics crown?
A benchmark analysis of pandas, polars, modin, dask
Dudhraj Sandeep
Sep 13
Categories of Data Engineering Roles
Categories of Data Engineering Roles
An Overview of Different Types of Data Engineering Roles
Lorena Gongang
Sep 10
22 Essential SQL Interview Questions and Answers -Part 1
22 Essential SQL Interview Questions and Answers -Part 1
Prepare for your next SQL interview with confidence! This article covers 22 crucial SQL questions, providing clear explanations and…
Arpita Mishra
Sep 9
Traits Of A Great Data Engineering Manager
Traits Of A Great Data Engineering Manager
Key Attributes for Building and Leading Successful Data Engineering Teams
Santosh Joshi
Sep 6
5 Key Mindset Shifts to Succeed in Data Engineering
5 Key Mindset Shifts to Succeed in Data Engineering
Forget the Roadmaps You’ve Seen — Create Your Own Path in Data Engineering
Tim Webster
Sep 6
Modern Data Engineering in the LLM Era
Modern Data Engineering in the LLM Era
How Large Language Models are Shaping the Future of Data Engineering
Pavan Emani
Sep 6
From Zero to Data Engineer: What I’d Do Differently Today
From Zero to Data Engineer: What I’d Do Differently Today
Strategies for Fast-Tracking Your Data Engineering Career
Pavan Emani
Sep 3
Stop using Lambdas to trigger AWS Glue workflows based on S3 Events!
Stop using Lambdas to trigger AWS Glue workflows based on S3 Events!
How to use Eventbridge to trigger Glue jobs
Pavan Emani
Sep 2
Important SQL Topics for Data Engineers
Important SQL Topics for Data Engineers
A Comprehensive Beginner’s Guide to Mastering SQL
Nnamdi Samuel
Aug 31
Traits Of A Great Data Engineer
Traits Of A Great Data Engineer
What Makes Top Performers Stand Out in Data Engineering
Santosh Joshi
Aug 30
SQL: You Can’t Be a Data Engineer Without It (Non-Negotiable)
SQL: You Can’t Be a Data Engineer Without It (Non-Negotiable)
Why SQL is Essential for Your Career
Tim Webster
Aug 29
About Art of Data Engineering
Latest Stories
Archive
About Medium
Terms
Privacy
Teams