Homepage
Open in app
Sign in
Get started
Towards Data Engineering
Navigating the Path to Data Engineering Excellence
About
Follow
Trending
The Most discussed Spark Questions in 2024
The Most discussed Spark Questions in 2024
Solon Das
Apr 27
Most Asked Questions on Data Pipeline Design
Most Asked Questions on Data Pipeline Design
These are the most asked questions :
Solon Das
Apr 15
Data processing architectures — Lambda vs Kappa for Big Data.
Data processing architectures — Lambda vs Kappa for Big Data.
In the world of big data, there are many ways to process and analyze large volumes of data. Two popular approaches are Lambda Architecture…
Ayush Dixit
Mar 18, 2023
Latest
Why You Must Start Partitioning Your Data Today!
Why You Must Start Partitioning Your Data Today!
Learn why it’s essential, with practical steps and real-world examples, to manage large datasets effectively.
Rui Carvalho
Aug 18
Solving LinkedIn’s Queens Puzzle with Code
Solving LinkedIn’s Queens Puzzle with Code
Introduction to Z3 Library
Ali Masri
Aug 16
The Data Security Duo: Data Encryption and Vulnerability Scans
The Data Security Duo: Data Encryption and Vulnerability Scans
Lulu Cheng
Aug 15
The Hidden Traps of Data Modeling: Unmasking Common Anti-Patterns
The Hidden Traps of Data Modeling: Unmasking Common Anti-Patterns
Data modeling is often considered the foundation of any successful data-driven project. It’s the blueprint that dictates how data is…
Koushik Thota
Aug 12
How Data Encryption Can Simplify Infrastructure Architecture
How Data Encryption Can Simplify Infrastructure Architecture
Product and infrastructure engineering teams are not always aligned with the interests of security engineering teams. While product and…
Lulu Cheng
Aug 11
Understanding Table Formats in Data Lakes: A Comprehensive Guide
Understanding Table Formats in Data Lakes: A Comprehensive Guide
Photo by Jan Antonin Kolar on Unsplash
Koushik Thota
Jun 1
A Complete Guide to Slowly Changing Dimensions with Databricks Delta Tables
A Complete Guide to Slowly Changing Dimensions with Databricks Delta Tables
In data warehousing, Slowly Changing Dimensions (SCD) are essential for accurately tracking and managing changes in data over time. This…
Omar LARAQUI
Dec 21, 2023
Data-Intensive System Building Blocks: Distributed Databases
Data-Intensive System Building Blocks: Distributed Databases
Enhancing Scalability, Reliability, and Performance in Modern Data Management
Aleh Belausau
Aug 6
What is Data Warehouse and Data Modeling ?
What is Data Warehouse and Data Modeling ?
The Ultimate Guide to Data Warehousing and Data Modeling in 2024
Syed Kadar Ansari Syed Ahamed
Apr 24, 2023
Customize Apache Superset Home Page to fit any HTML Block
Customize Apache Superset Home Page to fit any HTML Block
Two ways to configure the default welcome page to include any additional information
Aman Ranjan Verma
Jul 27
About Towards Data Engineering
Latest Stories
Archive
About Medium
Terms
Privacy
Teams