Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

yarn resource manager path for automatic failover property

Highlighted

yarn resource manager path for automatic failover property

New Contributor

Hello,

I am not able to identify where exactly this property is set for Yarn RM failover
'ActiveStandbyElector' for automatic failover
Please provide the path and property where I can check this

Thanks
Nani

5 REPLIES 5

Re: yarn resource manager path for automatic failover property

New Contributor

I am able to check this properties in the path /usr/hdp/current/hadoop-yarn-resourcemanager/etc/Hadoop/yarn-site

<property>

<name>yarn.resourcemanager.ha.automatic-failover.zk-base-path</name>

<value>/yarn-leader-election</value>

</property>


<property>

<name>yarn.resourcemanager.ha.enabled</name>

<value>true</value>

</property>

am I looking correct path?

Re: yarn resource manager path for automatic failover property

Super Mentor

@Nani Bigdata


Is there any specific reason that you are looking out for that particular property "ActiveStandbyElector" Path?

Is your ResourceManager HA not functioning properly?


Although you can find that path "ActiveStandbyElector" here

Example:

1). Connect to your Zookeeper Quorum using "zkCli.sh" as following:

# /usr/hdp/current/zookeeper-client/bin/zkCli.sh  -server newhwx1.example.com,newhwx2.example.com,newhwx3.example.com:2181


2). List the contents of "ls /yarn-leader-election/yarn-cluster"

[zk: newhwx1.example.com,newhwx2.example.com,newhwx3.example.com:2181(CONNECTED) 2]  ls /yarn-leader-election/yarn-cluster
[ActiveBreadCrumb, ActiveStandbyElectorLock]


3). "" Get.

[zk: newhwx1.example.com,newhwx2.example.com,newhwx3.example.com:2181(CONNECTED) 3] get /yarn-leader-election/yarn-cluster/ActiveStandbyElectorLoc

yarn-cluster rm2
cZxid = 0x9000aee67
ctime = Mon Jun 17 03:24:12 UTC 2019
mZxid = 0x9000aee67
mtime = Mon Jun 17 03:24:12 UTC 2019
pZxid = 0x9000aee67
cversion = 0
dataVersion = 0
aclVersion = 0
ephemeralOwner = 0x26ab8da9f808066
dataLength = 19
numChildren = 0





Re: yarn resource manager path for automatic failover property

Super Mentor

@Nani Bigdata

Does it answers your query? Or do you have any additional query in this regard?
If not then please mark this HCC thread as resolved by clicking on the "Accept" Button.

Re: yarn resource manager path for automatic failover property

New Contributor

Thank you Jay for detailed reply. I need to property 'ActiveStandbyElector' from zookeeper stand point of view , like how it selects standby Resource manager to active one's. so you say, we can get this details by connecting to zookeeper and listing the contents in yarn? thank you once again

Re: yarn resource manager path for automatic failover property

Super Mentor

@Nani Bigdata

There are better other options as well to find out the Active/StandBy ResourceManagers.

1. Using command line as following. Please replace the "rm1" and "rm2" according to your config "yarn.resourcemanager.ha.rm-ids".

# su - yarn -c "yarn rmadmin -getServiceState rm1"
standby
[root@newhwx2 ~]# su - yarn -c "yarn rmadmin -getServiceState rm2"
active


2. Using Ambari API calls:

# curl -s -u admin:admin -H "X-Requested-By: ambari" -X GET "http://<ambari-host>:<ambari-port>/api/v1/clusters/<cluster-name>/host_components?HostRoles/component_name=RESOURCEMANAGER&HostRoles/ha_state=ACTIVE" | grep -B1 -i "host_name"  
# curl -s -u admin:admin -H "X-Requested-By: ambari" -X GET "http://<ambari-host>:<ambari-port>/api/v1/clusters/<cluster-name>/host_components?HostRoles/component_name=RESOURCEMANAGER&HostRoles/ha_state=STANDBY" | grep -B1 -i "host_name"  

.

.


Don't have an account?
Coming from Hortonworks? Activate your account here