Agile Lab Engineering

Extending Flink functions

For the most part, frameworks provide all kinds of built-in functions, but it would be cool to have the chance to…

Scala “fun” error handling — Part 2

Last time we saw how we can encode our results into Either or Option and then combine these…

Data Mesh explanation

How and why successful data-driven companies are adopting Data Mesh

Spark Remote Debugging

Hi everybody! I’m a Big Data Engineer @ Agile Lab, a remote-first Big Data engineering and R&D firm located in Italy…

Spark 3.0: First hands-on approach with Adaptive Query Execution (Part 3)

Spark 3.0: First hands-on approach with Adaptive Query Execution (Part 2)

The secret to reduce Spark Application costs

Who among you now has reasonable assurance that all your…

Spark 3.0: First hands-on approach with Adaptive Query Execution (Part 1)

How to create an Apache Spark 3.0 development cluster on a single machine using Docker