YARN High Availability — Enable/Disable

Assumptions:

• You’ve a fair bit of idea about YARN’s architecture and working
• You’ve installed Cloudera Manager on GCP/other cloud/on-prem

Enable

Login to Cloudera Manager. Open YARN and click on Actions -> Enable High Availability

Select the other host for standby Resource Manager (RM)

Second host selected for RM standby (bottom right)

RM HA Commands execution in progress

RM HA completed

Disable

Disabling HA in Resource Manager of YARN

Disabling the standby of HA

Disabling commands execution in progress

RM HA disabled

Yarn’s HA is similar to HDFS’, i.e. through Zookeeper, have a look at how it works here

Or how to enable/disable HDFS HA through Cloudera Manager here

If you are using free-credits provided by your choice of cloud-vendor, please do ensure you shut down your applications & VMs in order to save credits. More details here

Big Data Analytics Pipeline using the Hadoop Ecosystem