Mesos + Marathon

Background

Apache Mesos is distributed resource manamgement tool. It abstracts CPU, memory, storage, and other compute resources away from machines (physical or virtual), enabling fault-tolerant and elastic distributed systems to easily be built and run effectively. It has been proven to be able support 10,000s of nodes.

Marathon runs on top of Apache Mesos. It is similar to linux init.d/systemd. It manages long time running services across multiple nodes.

Demo

In this demo, I will show how to use mesos and marathon to deploy a web applicaiton on scale.

In this demo, I will show how to auto-scale a spark streaming applicaiton using marathon API.