Open in app
Sign inGet started
Free Hosted Spark UI & Spark History Server

Free Hosted Spark UI & Spark History Server

How to install our free, open-source, Spark UI & Spark History Server on top of any Spark platform
Go to the profile of Jean Yves
Jean Yves
Spark on Kubernetes Made Easy: How Data Mechanics Improves On The Open-Source Version

Spark on Kubernetes Made Easy: How Data Mechanics Improves On The Open-Source Version

If you’re looking for a high-level introduction about Spark on Kubernetes, check out The Pros And Cons of Running Spark on Kubernetes, and…
Go to the profile of Jean Yves
Jean Yves
How to be successful with Apache Spark in 2021 — Data Mechanics Blog

How to be successful with Apache Spark in 2021 — Data Mechanics Blog

Apache Spark is the leading technology for data engineering. But making Spark easy-to-use, stable, and cost-efficient remains challenging.
Go to the profile of Hisham Itani
Hisham Itani
Spark and Docker: Your Spark development cycle just got 10x faster!

Spark and Docker: Your Spark development cycle just got 10x faster!

Native support for Docker is one of the main reasons companies choose to deploy Spark on top of Kubernetes instead of YARN.
Go to the profile of Hisham Itani
Hisham Itani
The Pros and Cons of Running Apache Spark on Kubernetes

The Pros and Cons of Running Apache Spark on Kubernetes

Kubernetes support was only recently added for Spark. How does it compare to other deployment modes and is it worth it?
Go to the profile of Hisham Itani
Hisham Itani
Performance of Apache Spark on Kubernetes has caught up with YARN

Performance of Apache Spark on Kubernetes has caught up with YARN

Learn our benchmark setup, results, as well as critical tips to make shuffles up to 10x faster when running on Kubernetes!
Go to the profile of Hisham Itani
Hisham Itani
Data Mechanics Delight — We’re building a better Apache Spark UI

Data Mechanics Delight — We’re building a better Apache Spark UI

“The Spark UI is my favorite monitoring tool” — said no one ever.
Go to the profile of Hisham Itani
Hisham Itani
How we built a Serverless Spark Platform on Kubernetes — Video Tour of Data Mechanics

How we built a Serverless Spark Platform on Kubernetes — Video Tour of Data Mechanics

Our mission at Data Mechanics is to give data engineers & scientists the ability to easily build pipelines & models over large datasets.
Go to the profile of Hisham Itani
Hisham Itani
How-to guide: Set up, Manage & Monitor Spark on Kubernetes (with code examples)

How-to guide: Set up, Manage & Monitor Spark on Kubernetes (with code examples)

Here’s why (and how) you should be using Spark on Kubernetes!
Go to the profile of Hisham Itani
Hisham Itani
About Data MechanicsLatest StoriesArchiveAbout MediumTermsPrivacy