Amit Kumar – Medium

Amit Kumar

Pinned

Spark Broadcasting

In Spark, broadcasting refers to the process of sending a read-only copy of a variable to all worker nodes in a cluster. This allows each…

Jan 20

Jan 20

Shuffle Sort Merge

Shuffle Sort Merge Join is a strategy used in Apache Spark that involves three main phases: shuffling the datasets based on join keys…

Jan 21

Jan 21

Shuffle Hash Join

A shuffle hash join is a specific type of join that Spark uses when the datasets are too large to fit into memory. Here’s how it works…

Jan 20

Jan 20

Amit Kumar

Amit Kumar

I am a passionate Data Engineer with 3 of experience in designing, building, and maintaining robust data pipelines.

Following

Help

Status

About

Careers

Press

Blog

Privacy

Rules

Terms

Text to speech