Install Spark on Windows (PySpark)

Install PySpark on Windows
  1. Download and install Gnu on windows (GOW) from the following link. Basically, GOW allows you to use linux commands on windows. In this install, we will need curl, gzip, tar which GOW provides.
Linux Commands on Windows
Download Apache Spark
pyspark local

--

--

--

Data Scientist https://www.linkedin.com/in/michaelgalarnyk/

Love podcasts or audiobooks? Learn on the go with our new app.

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Michael Galarnyk

Michael Galarnyk

Data Scientist https://www.linkedin.com/in/michaelgalarnyk/

More from Medium

Learning Spark — Part 1 Spark Environment Installation

PySpark Basics — Create a test dataframe

How to create a Spark data frame from a pre-signed S3 URL? : Data Engineering Series

Apache Spark >> Schema