Set Up Google Cloud DataProc Job Monitoring
In this post, we’ll setup Google DataProc job monitoring so that we can get notified whenever a DataProc job fails.
Note: We’ll setup all resources in us-central1 region and our DataProc cluster is also supposed to run in us-central1 region.
Step1: Google Cloud doesn’t have a service similar to AWS SES, so we’ll be using a third party service from Google Cloud market place.
Go to Marketplace and subscribe to SendGrid Email API and generate API key. SendGrid’s free plan allows us to send 12000 mail per…