IBM Analytics Engine — Serverless Spark — End to End Demo
Short Video Demos — Run Spark workloads, Troubleshoot using Spark UI/ Spark History in combination with Logs
DEMO START
This video blog is a series of quick, short demos on various concepts of IBM Analytics Engine Serverless plan — right from creating and configuring an “instance”, running spark workloads, troubleshooting the run through a combination of the application run logs and through Spark UI / Spark History
P.S These demos do no have a voiceover. If you don’t want to listen to the background music, you can turn down the volume.
➡️ Demo 1: Creating an AE-Serverless Spark Instance
➡️ Demo 2: Viewing an AE-Serverless Spark Instance
➡️ Demo 3: Creating a platform logs enabled Log Analysis Instance
➡️ Demo 4: Enabling Logs for IBM Analytics Engine Instance
📌 Before going to Demo 4, understand the concepts of how to run a spark application on IBM Analytics Engine. All of the code referred in the demo can be found in product documentation and also in these blogs/tutorials below:
>> This article explains how you can submit applications using REST API: https://mrudulamadiraju.medium.com/just-3-curls-take-your-first-steps-with-analytics-engine-serverless-spark-api-6d59b57fa81
>> This article explains the fundamental concepts of storing your application/data on object store and how you reference them in Spark applications : https://medium.com/@mrudulamadiraju/store-upto-25-gb-data-per-month-for-free-on-cloud-object-storage-4a946daa4e43
>>This tutorial explains how to submit applications using the IBM Cloud CLI: https://cloud.ibm.com/docs/AnalyticsEngine?topic=AnalyticsEngine-using-cli
➡️ Demo 5: Analytics Engine — Spark UI & Spark History
DEMO END
What else would you like to see a demo of? Let me know through a private note or a comment.