Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

YARN DNS registry server not started in hortonworks 3.0?

Highlighted

YARN DNS registry server not started in hortonworks 3.0?

New Contributor

i newly installed HDP 3.0 on my computer,before i was using HDP 2.6.x it was working fine.But after installing HDP3.0, a newly introduced component YARN DNS registry server not starting showing address already binded exception.

i tried it in two computers seperately with fresh insatllation of Ubuntu 16.04 and HDP3.0 on both the machines it is showing same error.

sufred a lot but no hope.there is no proper solution available in internet.

appreiciated your help on this.

Thanks in advanced

4 REPLIES 4

Re: YARN DNS registry server not started in hortonworks 3.0?

Mentor

@manikandan ayyasamy

Thats a port confict issue that is new with HDP 3.0, the incriminating port is 53 for the DNS listener.IThe only solution I have so far found is locating the process occupying the port and killing the PID /var/log/hadoop-yarn/yarn/privileged-root-registrydns-FQDN.err

# sudo lsof -i -P -n

Then

# kill -9 <PID> 

Now you can start your registry-dns from Ambari.

Here is a documentation to explain that look especially at the entry Configure Registry DNS

Re: YARN DNS registry server not started in hortonworks 3.0?

Contributor

For others, here is an example of my terminal input when solving this problem:


[root@HW01 ~]# cat /var/log/hadoop-yarn/yarn/privileged-root-registrydns-HW01.co.local.err

java.net.BindException: Problem binding to [HW01.co.local:53] java.net.BindException: Address already in use; For more details see: http://wiki.apache.org/hadoop/BindException

at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)

at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)

at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)

at java.lang.reflect.Constructor.newInstance(Constructor.java:423)

at org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:831)

at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:736)

at org.apache.hadoop.registry.server.dns.RegistryDNS.openUDPChannel(RegistryDNS.java:1016)

at org.apache.hadoop.registry.server.dns.RegistryDNS.addNIOUDP(RegistryDNS.java:925)

at org.apache.hadoop.registry.server.dns.RegistryDNS.initializeChannels(RegistryDNS.java:196)

at org.apache.hadoop.registry.server.dns.PrivilegedRegistryDNSStarter.init(PrivilegedRegistryDNSStarter.java:59)

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)

at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

at java.lang.reflect.Method.invoke(Method.java:498)

at org.apache.commons.daemon.support.DaemonLoader.load(DaemonLoader.java:207)

Caused by: java.net.BindException: Address already in use

at sun.nio.ch.Net.bind0(Native Method)

at sun.nio.ch.Net.bind(Net.java:433)

at sun.nio.ch.DatagramChannelImpl.bind(DatagramChannelImpl.java:691)

at sun.nio.ch.DatagramSocketAdaptor.bind(DatagramSocketAdaptor.java:91)

at org.apache.hadoop.registry.server.dns.RegistryDNS.openUDPChannel(RegistryDNS.java:1014)

... 8 more

Cannot load daemon

Service exit with a return value of 3


[root@HW01 ~]# lsof -i -P -n | grep ':53'

avahi-dae 2140 avahi 12u IPv4 25507 0t0 UDP *:5353

dnsmasq 3080 nobody 5u IPv4 35043 0t0 UDP 192.168.122.1:53

dnsmasq 3080 nobody 6u IPv4 35044 0t0 TCP 192.168.122.1:53 (LISTEN)

java 118018 infra-solr 229u IPv6 31471850 0t0 TCP 172.18.4.46:8886->172.18.4.46:53816 (ESTABLISHED)

java 118018 infra-solr 241u IPv6 31471130 0t0 TCP 172.18.4.46:53816->172.18.4.46:8886 (ESTABLISHED)

java 134005 accumulo 318u IPv4 31459695 0t0 TCP 172.18.4.46:12234->172.18.4.48:53562 (ESTABLISHED)

java 135984 druid 648u IPv4 31594196 0t0 UDP 172.18.4.46:38510->172.18.4.12:53

java 135984 druid 649u IPv4 31594289 0t0 UDP 172.18.4.46:57316->172.18.4.11:53

java 138702 oozie 799u IPv6 31451570 0t0 TCP 172.18.4.46:53096->172.18.4.48:3306 (ESTABLISHED)

java 138702 oozie 800u IPv6 31454483 0t0 TCP 172.18.4.46:53100->172.18.4.48:3306 (ESTABLISHED)


[root@HW01 ~]# kill -9 3080


[root@HW01 ~]# lsof -i -P -n | grep ':53'

avahi-dae 2140 avahi 12u IPv4 25507 0t0 UDP *:5353

java 118018 infra-solr 229u IPv6 31471850 0t0 TCP 172.18.4.46:8886->172.18.4.46:53816 (ESTABLISHED)

java 118018 infra-solr 241u IPv6 31471130 0t0 TCP 172.18.4.46:53816->172.18.4.46:8886 (ESTABLISHED)

java 134005 accumulo 318u IPv4 31459695 0t0 TCP 172.18.4.46:12234->172.18.4.48:53562 (ESTABLISHED)

java 138702 oozie 799u IPv6 31451570 0t0 TCP 172.18.4.46:53096->172.18.4.48:3306 (ESTABLISHED)

java 138702 oozie 800u IPv6 31454483 0t0 TCP 172.18.4.46:53100->172.18.4.48:3306 (ESTABLISHED)


Re: YARN DNS registry server not started in hortonworks 3.0?

Mentor

@manikandan ayyasamy

Any update on this please accept the answer and to close the thread

Re: YARN DNS registry server not started in hortonworks 3.0?

New Contributor

still it is failing, i am keep on trying. i will let you know once it is done