Archives of Support Questions (Read Only)

This is an archived board for historical reference. Information and links may no longer be available or relevant
Announcements
This board is archived and read-only for historical reference. To ask a new question, please post a new topic on the appropriate active board.

ResourceManager yarn HA fail - Sandbox at single node - Only rm2 work , but rm1 have some problem

avatar
New Member

Step 1. vi /etc/hadoop/conf/yarn-site.xml

Add Follow line

<property> <name>yarn.resourcemanager.ha.id</name>

<value>rm1</value>

<description>If we want to launch more than one RM in single node, we need this configuration</description> </property>

<property>

<name>yarn.resourcemanager.ha.id</name>

<value>rm2</value>

<description>If we want to launch more than one RM in single node, we need this configuration</description>

</property>

<!-- RM1 Configs -->

<property>

<name>yarn.resourcemanager.address.rm1</name>

<value>sandbox.hortonworks.com:23140</value>

</property>

<property>

<name>yarn.resourcemanager.scheduler.address.rm1</name>

<value>sandbox.hortonworks.com:23130</value>

</property>

<property>

<name>yarn.resourcemanager.webapp.address.rm1</name>

<value>sandbox.hortonworks.com:23188</value>

</property>

<property>

<name>yarn.resourcemanager.resource-tracker.address.rm1</name>

<value>sandbox.hortonworks.com:23125</value>

</property>

<property>

<name>yarn.resourcemanager.admin.address.rm1</name>

<value>sandbox.hortonworks.com:23141</value>

</property>

<!-- RM2 configs -->

<property>

<name>yarn.resourcemanager.address.rm2</name>

<value>sandbox.hortonworks.com:33140</value>

</property>

<property>

<name>yarn.resourcemanager.scheduler.address.rm2</name>

<value>sandbox.hortonworks.com:33130</value>

</property>

<property>

<name>yarn.resourcemanager.webapp.address.rm2</name>

<value>sandbox.hortonworks.com:33188</value>

</property>

<property>

<name>yarn.resourcemanager.resource-tracker.address.rm2</name>

<value>sandbox.hortonworks.com:33125</value>

</property>

<property>

<name>yarn.resourcemanager.admin.address.rm2</name>

<value>sandbox.hortonworks.com:33141</value>

</property>

<property>

<name>yarn.resourcemanager.ha.enabled</name>

<value>true</value>

</property>

<property>

<name>yarn.resourcemanager.ha.rm-ids</name>

<value>rm1,rm2</value>

</property>

<property>

<name>yarn.resourcemanager.recovery.enabled</name>

<value>true</value>

</property>

<property>

<name>yarn.resourcemanager.store.class</name> <value>org.apache.hadoop.yarn.server.resourcemanager.recovery.ZKRMStateStore</value>

</property>

<property>

<name>yarn.resourcemanager.zk-address</name>

<value>sandbox.hortonworks.com:2181</value>

<description>For multiple zk services, separate them with comma</description>

</property>

<property>

<name>yarn.resourcemanager.cluster-id</name>

<value>yarn-cluster</value>

</property>

<property>

<name>yarn.resourcemanager.ha.automatic-failover.zk-base-path</name>

<value>/yarn-leader-election</value>

<description>Optional setting. The default value is /yarn-leader-election</description>

</property>

<property>

<name>yarn.resourcemanager.cluster-id</name>

<value>yarn-cluster</value>

</property>

<property>

<name>yarn.resourcemanager.zk-state-store.address</name>

<value>sandbox.hortonworks.com:2181</value>

</property>

Manual Start ZooKeeper.Start hdfs Start yarn .. .

[yarn@sandbox ~]$ yarn rmadmin -getServiceState rm1 15/12/29 08:43:30 INFO ipc.Client: Retrying connect to server: sandbox.hortonworks.com/192.168.182.145:23141. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=1, sleepTime=1000 MILLISECONDS) Operation failed: Call From sandbox.hortonworks.com/192.168.182.145 to sandbox.hortonworks.com:23141 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused

[yarn@sandbox ~]$ yarn rmadmin -getServiceState rm2

standby

1 ACCEPTED SOLUTION

avatar

You can't have High Availability for any service i.e. Resource Manager in your case, in a single machine sandbox environment.

View solution in original post

2 REPLIES 2

avatar
Super Collaborator

Configuring HA on single node is not expected thing to do.

avatar

You can't have High Availability for any service i.e. Resource Manager in your case, in a single machine sandbox environment.