Open in app
Sign inGet started
Trending
Databricks is Now Free for Learners — No Cloud Account Required!

Databricks is Now Free for Learners — No Cloud Account Required!

In a major win for the data learning community, Databricks has just made its platform freely available for learners — no cloud account or…
Go to the profile of THE BRICK LEARNING
THE BRICK LEARNING
Fail Fast or Quarantine? Two Data Quality Patterns Every Spark Engineer Should Know

Fail Fast or Quarantine? Two Data Quality Patterns Every Spark Engineer Should Know

Learn when to fail fast or quarantine bad data in Spark pipelines.
Go to the profile of Marcel Kennert
Marcel Kennert
Databricks Quietly Prepares Platform for Real-Time Data Apps — Starting with Databricks Apps and…

Databricks Quietly Prepares Platform for Real-Time Data Apps — Starting with Databricks Apps and…

In the age of intelligent applications, the next wave of digital transformation is being fueled by real-time Data Apps — systems that…
Go to the profile of THE BRICK LEARNING
THE BRICK LEARNING
Latest
Databricks Data Engineering Preparation Question 4: What Does the MODIFY Privilege Actually Grant…

Databricks Data Engineering Preparation Question 4: What Does the MODIFY Privilege Actually Grant…

Question:  A data engineer uses the following SQL query:
Go to the profile of THE BRICK LEARNING
THE BRICK LEARNING
Introducing Serverless Compute for Workflows: Simpler, Smarter Job Execution

Introducing Serverless Compute for Workflows: Simpler, Smarter Job Execution

Databricks has officially made Serverless Compute for Workflows generally available, bringing a new level of simplicity and performance to…
Go to the profile of THE BRICK LEARNING
THE BRICK LEARNING
Databricks Data Engineering Interview Question 3: OPTIMIZE Your Delta Tables: Compacting Files in…

Databricks Data Engineering Interview Question 3: OPTIMIZE Your Delta Tables: Compacting Files in…

Which of the following commands can a data engineer use to compact small data files of a Delta table into larger ones?
Go to the profile of THE BRICK LEARNING
THE BRICK LEARNING
Databricks Data Engineering Associate Preparation Question 2: Understanding Execution Modes in…

Databricks Data Engineering Associate Preparation Question 2: Understanding Execution Modes in…

Question:  The data engineer team has a DLT pipeline that updates all the tables at defined intervals until manually stopped. The compute…
Go to the profile of THE BRICK LEARNING
THE BRICK LEARNING
Databricks Data Engineer Associate Preparation Question 1: What Does Cron Syntax Represent in…

Databricks Data Engineer Associate Preparation Question 1: What Does Cron Syntax Represent in…

Question:
Go to the profile of THE BRICK LEARNING
THE BRICK LEARNING
Understanding Spark’s Catalyst Optimizer: Demystifying Query Optimization

Understanding Spark’s Catalyst Optimizer: Demystifying Query Optimization

Non-members can access the full article through this Link.
Go to the profile of Ritam Mukherjee
Ritam Mukherjee
From Data Assumptions to Data Quality Assurance: Why we need Testing, Cleaning, and Monitoring

From Data Assumptions to Data Quality Assurance: Why we need Testing, Cleaning, and Monitoring

Introduction
Go to the profile of Naidu Rongali - Senior Big Data and ML Engineer
Naidu Rongali - Senior Big Data and ML Engineer
11 High Performance Query Engines I Wish I Knew About Sooner

11 High Performance Query Engines I Wish I Knew About Sooner

How I stopped waiting and started analyzing Victor Oketch Sabare · 6 min read · Jun 14, 2025
Go to the profile of Victor Oketch Sabare
Victor Oketch Sabare
ClickHouse in the Wild: An Odyssey Through Our Data-Driven Marketing Campaign in Q-Commerce

ClickHouse in the Wild: An Odyssey Through Our Data-Driven Marketing Campaign in Q-Commerce

Key visual of “SuperSanj” campaign, ran by Snapp! Market
Go to the profile of Parham Abbasi
Parham Abbasi
Microsoft Fabric for Data Engineers: A Practical Introduction

Microsoft Fabric for Data Engineers: A Practical Introduction

Why Microsoft Fabric Matters to Data Engineers
Go to the profile of RAKESH CHANDA
RAKESH CHANDA
About Towards Data EngineeringLatest StoriesArchiveAbout MediumTermsPrivacyTeams