Open in app
Sign inGet started
Trending
10 Hard Topics in Data Engineering That Will Skyrocket Your Career

10 Hard Topics in Data Engineering That Will Skyrocket Your Career

Ever scroll through Reddit and wonder, “What actually separates a good data engineer from a great one?” I did after stumbling on a…
Go to the profile of Victor Oketch Sabare
Victor Oketch Sabare
Databricks Quietly Prepares Platform for Real-Time Data Apps — Starting with Databricks Apps and…

Databricks Quietly Prepares Platform for Real-Time Data Apps — Starting with Databricks Apps and…

In the age of intelligent applications, the next wave of digital transformation is being fueled by real-time Data Apps — systems that…
Go to the profile of THE BRICK LEARNING
THE BRICK LEARNING
My Interview Experience for Senior Data Engineer at Walmart

My Interview Experience for Senior Data Engineer at Walmart

I’m here to share my Senior Data Engineer interview experience with Walmart from December 2024. If you’re preparing for this role, I hope…
Go to the profile of Think Data
Think Data
Latest
Things Nobody Told Me About Data Engineering Until I Failed

Things Nobody Told Me About Data Engineering Until I Failed

Every Data Engineer Needs to Read This — Before It’s Too Late
Go to the profile of Rooted in Data
Rooted in Data
Learning Day 13: How to Ingest Data into Existing Delta Tables Using MERGE INTO — The Right Way

Learning Day 13: How to Ingest Data into Existing Delta Tables Using MERGE INTO — The Right Way

Mastering Incremental Loads, CDC, and SCDs with Delta Lake
Go to the profile of THE BRICK LEARNING
THE BRICK LEARNING
The Night I Caught a Fraud Ring in Real Time Using Kafka Streams & Neo4j

The Night I Caught a Fraud Ring in Real Time Using Kafka Streams & Neo4j

How I turned data chaos into instant alerts and how you can.
Go to the profile of Victor Oketch Sabare
Victor Oketch Sabare
Is Kimball Still Relevant in the Age of Lakehouse and Data Lakes?

Is Kimball Still Relevant in the Age of Lakehouse and Data Lakes?

In the ever evolving world of data engineering, it’s easy to assume that older paradigms like Kimball’s dimensional modeling have lost…
Go to the profile of Avinash Jha
Avinash Jha
Kibana vs Power BI: Two Data Worlds, One Decision

Kibana vs Power BI: Two Data Worlds, One Decision

Which Is Better for Your Team — Kibana or Power BI?
Go to the profile of Nitin Jha
Nitin Jha
Why Airflow + Snowflake Is the Power Combo Every Data Engineer Needs

Why Airflow + Snowflake Is the Power Combo Every Data Engineer Needs

“In data engineering, it’s not about doing more — it’s about doing it smarter, faster, and at scale.”
Go to the profile of Nitin Jha
Nitin Jha
How I Update Nested JSON in Databricks Using PySpark: A Step-by-Step Guide

How I Update Nested JSON in Databricks Using PySpark: A Step-by-Step Guide

A real-world PySpark solution to handle dynamic JSON arrays, root-level updates, and deep structure challenges in Databricks.
Go to the profile of Rooted in Data
Rooted in Data
Databricks: 7 Must-Know Concepts for Any Data Specialist

Databricks: 7 Must-Know Concepts for Any Data Specialist

“These 7 Databricks Concepts Saved Me Hours — And They’ll Help You Too
Go to the profile of Rooted in Data
Rooted in Data
How Salting Can Reduce Data Skew By 99%

How Salting Can Reduce Data Skew By 99%

Data skew means some values (like a user ID or product name) appear much more often than others. This causes one machine to get too much…
Go to the profile of Avinash Jha
Avinash Jha
ETL vs ELT: The Big Shift in Data Transformation — Made Simple (With Snowflake as the Game-Changer)

ETL vs ELT: The Big Shift in Data Transformation — Made Simple (With Snowflake as the Game-Changer)

The Great Data Flip: ETL vs ELT Explained — And How Snowflake Leads the Charge
Go to the profile of Nitin Jha
Nitin Jha
About Towards Data EngineeringLatest StoriesArchiveAbout MediumTermsPrivacyTeams