Set up a local Spark cluster step by step in 10 minutes

Set up a local Spark cluster with one master node and one worker node in Ubuntu from scratch completely, and for free.

Andrew Zhu (Shudong Zhu)
CodeX
Published in
3 min readMay 10, 2021

--

Tortle with 4 legs by Charles Zhu, my 6 yo son

This is an action list to install the open-sourced Spark master(or driver) and worker in local Ubuntu completely for free. (in contrast to Databricks for $$$)

--

--