question Re: Identify active YARN RM in Archives of Support Questions (Read Only)

Identify active YARN RM

nord_tramper — Tue, 10 Oct 2017 20:21:51 GMT

Is it possible to identify active YARN ResourceManager using ZooKeeper or any other method?

Re: Identify active YARN RM

asirna — Tue, 10 Oct 2017 21:42:20 GMT

You can get the active Yarn RM Id from zookeeer.

cd /usr/hdp/current/zookeeper-client/bin
./zkCli.sh -server <zk-quorum>
[zk: localhost:2181(CONNECTED) 14]: get /yarn-leader-election/<cluster-id>/ActiveStandbyElectorLock

Thanks,

Aditya

Re: Identify active YARN RM

asirna — Tue, 10 Oct 2017 21:50:21 GMT

@Nikita Kiselev,

You can also get it using Ambari REST API

http://<ambari-host>:<ambari-port>/api/v1/clusters/<cluster-name>/host_components?HostRoles/component_name=RESOURCEMANAGER&HostRoles/ha_state=ACTIVE

To get STANDBY RM , you can replace ha_state with STANDBY in the above URL

Thanks,

Aditya

Re: Identify active YARN RM

nord_tramper — Wed, 11 Oct 2017 01:36:39 GMT

Thanks! Which keytab I should use to get access to this Zookepper Node (kerberized cluster)? Is it possible to use ZooKeeper Java API to get same info?

Re: Identify active YARN RM

yvora — Wed, 11 Oct 2017 01:36:59 GMT

@Nikita Kiselev, you can also use yarn cli to figure out active/stand by RM.

You can find out RM-Ids from yarn-site.xml. Look for yarn.resourcemanager.ha.rm-ids properties.

<property>
<name> yarn.resourcemanager.ha.rm-ids</name>
<value> rm1, rm2</value>
</property>

Run "yarn rmadmin -getServiceState rm1" to find out state of RM1. It will return active if RM1 is an active RM or else it will return standby. You can run same command to know rm2 status too. ( yarn rmadmin -getServiceState rm2).

Re: Identify active YARN RM

asirna — Wed, 11 Oct 2017 12:17:42 GMT

You can use the yarn keytab to access this . (/etc/security/keytabs/yarn.headless.keytab).

Yes, can you access this using ZK Java API as well. Check the ZK Java example here.

Also, were you able to get it using the Ambari REST API as mentioned in my another answer.

Thanks,

Aditya