David Vrba – Medium

David Vrba
in
Towards Data Science

Building a Data Lake on PB scale with Apache Spark

How we deal with Big Data at Emplifi

15 min readJan 26, 2023

--

6

Building a Data Lake on PB scale with Apache Spark

--

6

David Vrba
in
Towards Data Science

Analyzing Stack Overflow Dataset with Apache Spark 3.0

13 min readDec 13, 2021

--

Analyzing Stack Overflow Dataset with Apache Spark 3.0

--

David Vrba
in
Towards Data Science

Nested Data Types in Spark 3.1

Working with structs in Spark SQL

6 min readJul 30, 2021

--

4

Nested Data Types in Spark 3.1

--

4

David Vrba
in
Towards Data Science

Higher-Order Functions with Spark 3.1

Processing Arrays in Spark SQL.

9 min readJul 26, 2021

--

1

Higher-Order Functions with Spark 3.1

--

1

David Vrba
in
Towards Data Science

Spark SQL 102 — Aggregations and Window Functions

Analytical functions in Spark for beginners.

7 min readJun 30, 2021

--

1

Spark SQL 102 — Aggregations and Window Functions

--

1

David Vrba
in
Towards Data Science

About Sort in Spark 3.x

Deep dive into data sorting in Spark SQL.

9 min readJun 27, 2021

--

2

About Sort in Spark 3.x

--

2

David Vrba
in
Towards Data Science

Highlights from Data + AI Summit NA 2021

6 min readMay 31, 2021

--

Highlights from Data + AI Summit NA 2021

--

David Vrba
in
Towards Data Science

Best Practices for Bucketing in Spark SQL

The ultimate guide to bucketing in Spark.

21 min readApr 25, 2021

--

7

Best Practices for Bucketing in Spark SQL

--

7

David Vrba
in
Towards Data Science

Performance in Apache Spark: benchmark 9 different techniques

Comparison of different approaches for array processing in Spark 3.1

12 min readMar 9, 2021

--

3

Performance in Apache Spark: benchmark 9 different techniques

--

3

David Vrba
in
Towards Data Science

A Decent Guide to DataFrames in Spark 3.0 for Beginners

Understand the transformations in a conceptual way.

12 min readJan 25, 2021

--

A Decent Guide to DataFrames in Spark 3.0 for Beginners

--

David Vrba

David Vrba

Senior ML Engineer at Sociabakers and Apache Spark trainer and consultant. I lecture Spark trainings, workshops and give public talks related to Spark.

Help
Status
About
Careers
Press
Blog
Privacy
Terms
Text to speech
Teams