question Re: What is the default Yarn resource manager port. Is it 8032 or 8050 in HDP2.3.4 and above. in Support Questions

What is the default Yarn resource manager port. Is it 8032 or 8050 in HDP2.3.4 and above.

anshul_sisodia — Tue, 14 Jun 2016 21:48:39 GMT

Hortonworks documentation says 8050 but yarn-default.xml says 8032. Also when I do netstat on resource manager node, it give 8032 port where resource manager is connecting and not 8050. I have got reference from one of the questions asked in community and it says this is a bug but might be a documentation error and docment team from Hortonworks has confirmed the port is 8032. See the below link and the update provided by Artem Ervits in the end:

https://community.hortonworks.com/questions/11599/how-to-change-resourcemanager-port-on-oozie.html#answer-21336

Could anyone confirm and let me know if its being resolved?

@Artem Ervits @Neeraj Sabharwal @pardeep

Re: What is the default Yarn resource manager port. Is it 8032 or 8050 in HDP2.3.4 and above.

ssathish — Wed, 15 Jun 2016 01:32:07 GMT

@Anshul Sisodia

The port is 8050.

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.4.0/bk_HDP_Reference_Guide/content/yarn-ports.html

Also you can verify by checking in /etc/hadoop/conf/yarn-site.xml for property 'yarn.resourcemanager.address'

Re: What is the default Yarn resource manager port. Is it 8032 or 8050 in HDP2.3.4 and above.

rpathak — Wed, 15 Jun 2016 02:09:22 GMT

@Anshul Sisodia

Are you using RM HA?

It makes a bit difference.

Re: What is the default Yarn resource manager port. Is it 8032 or 8050 in HDP2.3.4 and above.

KuldeepK — Wed, 15 Jun 2016 10:11:46 GMT

@Anshul Sisodia

In YARN HA, the property "yarn.resourcemanager.address" is redundant and instead "yarn.resourcemanager.address.X" is the one which is used.

1.) Ambari UI for YARN, shows only the property - yarn.resourcemanager.address And it uses port 8050 by default.

2.) In YARN UI, for the yarn configuration, the property is : yarn.resourcemanager.address.X yarn.resourcemanager.address.Y and they are using port 8032 by default.

Ambari UI does not explicitly shows "yarn.resourcemanager.address.X" or "yarn.resourcemanager.address.Y", rather only shows "yarn.resourcemanager.address".

In case if the requirement is to use a different port for the YARN HA ( other than 8032 ), then we can add "yarn.resourcemanager.address.X" and "yarn.resourcemanager.address.Y" in Ambari UI for customer yarn configuration.

Hope this information helps!

Happy Hadooping 🙂

Re: What is the default Yarn resource manager port. Is it 8032 or 8050 in HDP2.3.4 and above.

anshul_sisodia — Wed, 15 Jun 2016 13:18:48 GMT

Then why it is connecting to port 8032 and not 8050 in our cluster. I have HDP2.3.4. Do we need to explicitly set yarn.resourcemanager.address.X to <IP.master1>:8050 and yarn.resourcemanager.address.Y to

<IP.master2>:8050 in yarn-site.xml

Re: What is the default Yarn resource manager port. Is it 8032 or 8050 in HDP2.3.4 and above.

anshul_sisodia — Wed, 15 Jun 2016 13:20:04 GMT

Yes, I have RM HA

Re: What is the default Yarn resource manager port. Is it 8032 or 8050 in HDP2.3.4 and above.

anshul_sisodia — Fri, 17 Jun 2016 15:22:59 GMT

@Kuldeep Kulkarni , I tried this suggestion and it worked for me but oozie and spark jobs failed as they are not able to connect to current active RM. I had to manually switchover RM then restarted oozie and spark, then jobs started running. Weird though 🙂

Anyways do you have any document or KB Article related to your suggetsion where this is shown or described.

Again, Thanks for your time 🙂

Re: What is the default Yarn resource manager port. Is it 8032 or 8050 in HDP2.3.4 and above.

rpathak — Sat, 18 Jun 2016 00:07:59 GMT

@Anshul Sisodia

Ideally you should not worry about connecting to active RM.

The failover provider class takes care of that.

https://hadoop.apache.org/docs/r2.7.2/hadoop-yarn/hadoop-yarn-site/ResourceManagerHA.html#RM_Failover

Re: What is the default Yarn resource manager port. Is it 8032 or 8050 in HDP2.3.4 and above.

KuldeepK — Sun, 19 Jun 2016 15:33:55 GMT

@Anshul Sisodia - You are welcome! 🙂 Please accept the answer if you thing it has helped you.

Re: What is the default Yarn resource manager port. Is it 8032 or 8050 in HDP2.3.4 and above.

anshul_sisodia — Tue, 05 Jul 2016 14:19:44 GMT

Is it a bug that shows port 8050 in Ambari UI but connect to port 8032..?? I still dont understand as why it doesn't connect to 8050 if we have set Yarn.resourcemanager.address to <rmaddress:8050> rather than connecting to 8032.

Re: What is the default Yarn resource manager port. Is it 8032 or 8050 in HDP2.3.4 and above.

rpathak — Tue, 05 Jul 2016 14:33:42 GMT

@Anshul Sisodia

As Kuldeep pointed out when you have your RM in HA mode, yarn.resourcemanager.address value is not used to bind the port.

Instead it uses port specified in yarn.resourcemanager.address.{rm1,rm2} for respective RMs.

By default the value is 8032. Also Ambari do not set this by default.

Re: What is the default Yarn resource manager port. Is it 8032 or 8050 in HDP2.3.4 and above.

jimmyaneja — Fri, 31 Mar 2017 08:52:12 GMT

Hi in my case, I am seeing connection refused errors and in the url I notice that It says yarn.resourcemanager.address.X/ipaddress:port, my question is why do we have url/Ip_address:port instead of url:port?

Re: What is the default Yarn resource manager port. Is it 8032 or 8050 in HDP2.3.4 and above.

jimmyaneja — Fri, 31 Mar 2017 08:53:17 GMT

2017-03-30 18:17:25,834 [JobControl] WARN org.apache.hadoop.ipc.Client - Failed to connect to server: blah-1-001.blah.blah.blah.blah-blah.com/50.0.0.11:8032: retries get failed due to exceeded maximum allowed retries number: 0 java.net.ConnectException: Connection refused at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)

Re: What is the default Yarn resource manager port. Is it 8032 or 8050 in HDP2.3.4 and above.

mukund_agilisiu — Fri, 18 Aug 2017 20:26:48 GMT

Hi,

When submitting a job via Oozie, I am also getting a Connection Refused error, after configuring yarn.resourcemanager.address.X & yarn.resourcemanager.address.Y and using port 8032.

I have RM HA and Name Node HA

For some reason, it is attempting to connect to the standby RM and not the Active RM

Re: What is the default Yarn resource manager port. Is it 8032 or 8050 in HDP2.3.4 and above.

erkansirin78 — Wed, 18 Jul 2018 14:11:20 GMT

@Anshul Sisodia Should X and Y ports be different?