YARN ResourceManager Active/Standby Behavior

aseluk — Fri, 23 Jun 2017 04:53:12 GMT

I need help understanding the YARN ResourceManager Active/Standby behavior.

Setup Context:

Two nodes are configured to host the YARN ResourceManager service.
One node acts as "Active" while the other is "Standby".
High Availability is turned off. If the "Active" service is terminated, a fail-over should not occur.

In an attempt to better understand how the YARN ResourceManager functions, I stopped the "Active" service to study the log output. A fail-over did not occur, as expected in my statement above. When starting the "Active" service back up, I found the service relabeled as "Standby". Well over 5 minutes have passed and the service remains labeled as "Standby".

At this point, there are two "Standby" services. Only the original "Active" service shows log activity, as expected. The log activity displays a number of Metrics errors:

No live collector to send metrics to. Metrics to be sent will be discarded. This message will be skipped for the next 20 times.
Unable to connect to collector, http://null:6188/ws/v1/timeline/metricsThis exceptions will be ignored for next 100 times

Would anyone happen to be familiar with such a situation? I greatly appreciate your time and input.

Re: YARN ResourceManager Active/Standby Behavior

ssathish — Sat, 24 Jun 2017 01:36:50 GMT

Hi @Anthony Seluk,

When you disable High Availability, automatic failover also gets disabled.

Hence when active RM is killed, it doesn't do automatic failover to standby RM [that is, making standby RM as active]. So there will not be any active RM; instead we have two standbyRMs.

In such scenario, we need to do manual failover. More info on manual failover is given below

https://hadoop.apache.org/docs/stable/hadoop-yarn/hadoop-yarn-site/ResourceManagerHA.html

question Re: YARN ResourceManager Active/Standby Behavior in Archives of Support Questions (Read Only)

YARN ResourceManager Active/Standby Behavior

Re: YARN ResourceManager Active/Standby Behavior