Homepage
Open in app
Sign in
Get started
The Cloud-Native Spark Platform
Our mission: To make Spark more developer-friendly and cost-effective for data engineering teams. Our platform is deployed inside our customers cloud account (AWS, GCP, Azure), on a k8s cluster that we create and manage for them.
Follow
Free Hosted Spark UI & Spark History Server
Free Hosted Spark UI & Spark History Server
How to install our free, open-source, Spark UI & Spark History Server on top of any Spark platform
Jean Yves
Dec 8, 2020
Spark on Kubernetes Made Easy: How Data Mechanics Improves On The Open-Source Version
Spark on Kubernetes Made Easy: How Data Mechanics Improves On The Open-Source Version
If you’re looking for a high-level introduction about Spark on Kubernetes, check out The Pros And Cons of Running Spark on Kubernetes, and…
Jean Yves
Dec 2, 2020
How to be successful with Apache Spark in 2021 — Data Mechanics Blog
How to be successful with Apache Spark in 2021 — Data Mechanics Blog
Apache Spark is the leading technology for data engineering. But making Spark easy-to-use, stable, and cost-efficient remains challenging.
Hisham Itani
Nov 25, 2020
Spark and Docker: Your Spark development cycle just got 10x faster!
Spark and Docker: Your Spark development cycle just got 10x faster!
Native support for Docker is one of the main reasons companies choose to deploy Spark on top of Kubernetes instead of YARN.
Hisham Itani
Nov 7, 2020
The Pros and Cons of Running Apache Spark on Kubernetes
The Pros and Cons of Running Apache Spark on Kubernetes
Kubernetes support was only recently added for Spark. How does it compare to other deployment modes and is it worth it?
Hisham Itani
Oct 20, 2020
Performance of Apache Spark on Kubernetes has caught up with YARN
Performance of Apache Spark on Kubernetes has caught up with YARN
Learn our benchmark setup, results, as well as critical tips to make shuffles up to 10x faster when running on Kubernetes!
Hisham Itani
Oct 20, 2020
Data Mechanics Delight — We’re building a better Apache Spark UI
Data Mechanics Delight — We’re building a better Apache Spark UI
“The Spark UI is my favorite monitoring tool” — said no one ever.
Hisham Itani
Oct 20, 2020
How we built a Serverless Spark Platform on Kubernetes — Video Tour of Data Mechanics
How we built a Serverless Spark Platform on Kubernetes — Video Tour of Data Mechanics
Our mission at Data Mechanics is to give data engineers & scientists the ability to easily build pipelines & models over large datasets.
Hisham Itani
Oct 20, 2020
How-to guide: Set up, Manage & Monitor Spark on Kubernetes (with code examples)
How-to guide: Set up, Manage & Monitor Spark on Kubernetes (with code examples)
Here’s why (and how) you should be using Spark on Kubernetes!
Hisham Itani
Oct 20, 2020
About Data Mechanics
Latest Stories
Archive
About Medium
Terms
Privacy
Teams