Mohit DaxiniWhat is time series data?Lately, when I posted an article on interview question on time-series data, many comments which I received were related to explaination of…4d ago4d ago
Mohit DaxiniinTowards DevHow to aggregate time-series data in Spark ?This question is a medium level question frequently asked in Data Enginnering interviews in most product based companies. The question is…Jul 12Jul 12
Mohit DaxiniMost Efficient Way to Apply CDC (Change Data Capture) in Iceberg TablesChange Data Capture (CDC) is a technique used to identify and capture changes made to data in a database. Applying CDC in a data lake…Jul 1Jul 1
Mohit DaxiniinTowards DevSystem Design for Data EngineersIn today's data-driven world, designing systems that can efficiently handle massive data volumes is crucial. For data engineers, creating a…Jun 28Jun 28
Mohit DaxiniinDev Genius10 ways to optimize iterative processing in SparkThis question is a medium level question frequently asked in Data Enginnering interviews in most product based companies. The question is…Jun 25Jun 25
Mohit DaxiniSpark Interview Question — 6Recently, I came across a spark interview question on troubleshooting performance bottlenecks efficiently and thought to share the answer…Jun 24Jun 24
Mohit DaxiniSpark Interview Question — 5Recently, I came across a spark interview question on handling large datasets efficiently and thought to share the answer that I would have…Jun 23Jun 23
Mohit DaxiniSpark Interview Question — 4Recently, I came across a spark interview question on handling large datasets efficiently and thought to share the answer that I would have…Jun 191Jun 191
Mohit DaxiniWhy Apache Iceberg is Winning the Data Race!!In the rapidly evolving world of big data, organizations are continuously seeking innovative solutions to manage their ever-growing data…Jun 181Jun 181
Mohit DaxiniinTowards DevHarnessing Scopt and PureConfig for Scala: When to Use EachScopt and PureConfig are both used in Scala applications for handling configurations, but they serve different purposes and are used in…Jun 14Jun 14