Apache Spark On Apple Silicon

Install Spark(Scala, Python) on Macs having M1, M1 Pro, M1 Max, and M2 with this guide

Photo by Sumudu Mohottige on Unsplash

1. Install Homebrew:

/bin/bash -c "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/HEAD/install.sh)"
echo 'eval "$(/opt/homebrew/bin/brew shellenv)"' >> /Users/admin/.zprofile
eval "$(/opt/homebrew/bin/brew shellenv)"

2. Install Java:

brew install openjdk@11

3. Install Scala:

brew install scala

4. Install Python:

brew install python

5. Install Spark:

brew install apache-spark

6. Verify Spark — Scala:

spark-shell

7. Verify Spark — Python:

pyspark

--

--

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store