Homepage
Open in app
Sign in
Get started
Towards Data Engineering
Navigating the Path to Data Engineering Excellence
About
Follow
Trending
Why Parquet is the Best File Format for Big Data
Why Parquet is the Best File Format for Big Data
When working with big data, you want to store your data in a way that makes it easy to handle, quick to process, and doesn’t take up too…
Vishal Barvaliya
Aug 31
What’s New in Apache Spark 4.0
What’s New in Apache Spark 4.0
Apache Spark 4.0 has recently been released, bringing a host of new features and improvements that can make your data engineering tasks…
Vishal Barvaliya
Aug 25
Decodable vs. AWS Managed Service for Apache Flink (MSF): An End-to-End Data Engineering Showdown
Decodable vs. AWS Managed Service for Apache Flink (MSF): An End-to-End Data Engineering Showdown
In recent times, realtime data processing is becoming more and more essential. The ability for the business to proactively react to…
Yusuf Ganiyu
Sep 1
Latest
Mastering SQL Recursive CTEs: Key Concepts and Interview Questions
Mastering SQL Recursive CTEs: Key Concepts and Interview Questions
Unlock the Power of Recursive CTEs in SQL: Learn Key Concepts, Hierarchical Data Solutions, and Top Interview Questions to Boost Your…
Pritam Deb
Sep 6
Secure Data Stack: Navigating Adoption Challenges of Data Encryption
Secure Data Stack: Navigating Adoption Challenges of Data Encryption
Encryption is one of the most effective data security strategies, alongside access control, software updates, and network segmentation…
Lulu Cheng
Sep 3
The Generations Of Data Architecture: Past, Present, and Future
The Generations Of Data Architecture: Past, Present, and Future
The Evolution of Data Architecture | Everything You Need to Know About Modern Data Architecture.
RAKESH CHANDA
Sep 1
Introduction to Web3 Data Engineering
Introduction to Web3 Data Engineering
From silos to global data supply chains
Sergii Mikhtoniuk
Aug 29
Data Security Strategy Beyond Access Control: Data Encryption
Data Security Strategy Beyond Access Control: Data Encryption
The cost, frequency, and scale of data breaches continue to rise year over year. According to the IBM 2023 Cost of a Data Breach Report…
Lulu Cheng
Aug 29
Inside a Bank of America Data Engineering Interview.
Inside a Bank of America Data Engineering Interview.
A Real time Banking Use Case Question and How to Solve It Together.
Brahma, The Data Engineer.
Aug 28
How I Tuned Databricks Query Performance from Power BI Desktop: A Personal Journey.
How I Tuned Databricks Query Performance from Power BI Desktop: A Personal Journey.
Transforming Slow Reports into Lightning-Fast Dashboards: My Journey to Optimize Databricks and Power BI Integration.
Brahma, The Data Engineer.
Aug 25
Inside a CVS Pharmacy Data Engineering Interview.
Inside a CVS Pharmacy Data Engineering Interview.
A Real time Question from a Friend and How to Solve It Together.
Brahma, The Data Engineer.
Aug 23
Inside a Southwest Airlines Data Engineering Interview.
Inside a Southwest Airlines Data Engineering Interview.
A Real time interview Question from a Friend and How to Solve It Together.
Brahma, The Data Engineer.
Aug 21
Pyspark Interview Question: Inside a Walmart Data Engineering Interview.
Pyspark Interview Question: Inside a Walmart Data Engineering Interview.
A Real Question from a Friend and How to Solve It Together.
Brahma, The Data Engineer.
Aug 19
About Towards Data Engineering
Latest Stories
Archive
About Medium
Terms
Privacy
Teams