Faraaz – Medium

Faraaz

Spark Performance Tuning: Practical Strategies for Faster Jobs

Optimizing Apache Spark applications is a critical step for ensuring high performance and efficient resource utilization. This article…

Jan 15

Spark Performance Tuning: Practical Strategies for Faster Jobs

Jan 15

The Lifelong Learning Hack for Data Engineers: The 5-Hour Rule

In today’s fast-paced world of ever-evolving technology, staying relevant isn’t just a choice — it’s a necessity. As data engineers, the…

Dec 3, 2024

The Lifelong Learning Hack for Data Engineers: The 5-Hour Rule

Dec 3, 2024

Mastering Data Modelling: The Blueprint for Effective Data Engineering

In the realm of data engineering, data modelling is akin to the blueprint of a building. It lays the foundation for how data is structured…

Nov 28, 2024

Mastering Data Modelling: The Blueprint for Effective Data Engineering

Nov 28, 2024

Unlocking the Power of the QUALIFY Clause in SQL

Introduction

Jun 28, 2024

Unlocking the Power of the QUALIFY Clause in SQL

Jun 28, 2024

The Easy Ways to Clean Up Production Messes: A Delta Lake Tutorial

When it comes to working with production data, messes are bound to happen. Whether it’s data inconsistency, schema errors, or other issues…

Mar 6, 2023

The Easy Ways to Clean Up Production Messes: A Delta Lake Tutorial

Mar 6, 2023

Building a Mini ETL Pipeline with PySpark and Formula 1 Data

In this tutorial, we will walk through a simple ETL (Extract, Transform, Load) pipeline using PySpark and a dummy Formula 1 dataset. The…

Feb 24, 2023

Building a Mini ETL Pipeline with PySpark and Formula 1 Data

Feb 24, 2023

Why Delta Lake is a Better Solution Than Traditional Data Lakes

In today’s data-driven world, organizations are faced with the challenge of storing, managing, and processing large volumes of data. Data…

Feb 24, 2023

Why Delta Lake is a Better Solution Than Traditional Data Lakes

Feb 24, 2023

Faraaz

Faraaz

Faraaz works as a data engineer, leveraging his skills in Spark, Azure, Databricks, Python, and SQL to develop efficient and scalable data pipelines.

Following

Help

Status

About

Careers

Press

Blog

Privacy

Rules

Terms

Text to speech