Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

slider HA error "Invalid yarn.resourcemanager.address value:0.0.0.0:8032"

slider HA error "Invalid yarn.resourcemanager.address value:0.0.0.0:8032"

Explorer

I have a kerberized HA cloudera 5.8 cluster. I have set the properties in slider-client.xml per https://slider.incubator.apache.org/docs/high_availability.html. When running the list command I get the error:

Exception: java.net.BindException: Invalid yarn.resourcemanager.address value:0.0.0.0:8032 - see https://wiki.apache.org/hadoop/UnsetHostnameOrPort 2016-10-07 12:28:51,687 [main] ERROR main.ServiceLauncher - Exception: java.net.BindException: Invalid yarn.resourcemanager.address value:0.0.0.0:8032 - see https://wiki.apache.org/hadoop/UnsetHostnameOrPort org.apache.hadoop.service.ServiceStateException: java.net.BindException: Invalid yarn.resourcemanager.address value:0.0.0.0:8032 - see https://wiki.apache.org/hadoop/UnsetHostnameOrPort at org.apache.hadoop.service.ServiceStateException.convert(ServiceStateException.java:59) at org.apache.hadoop.service.AbstractService.init(AbstractService.java:172) at org.apache.slider.client.SliderClient.initHadoopBinding(SliderClient.java:490) at org.apache.slider.client.SliderClient.serviceInit(SliderClient.java:318) at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) at org.apache.slider.core.main.ServiceLauncher.launchService(ServiceLauncher.java:182) at org.apache.slider.core.main.ServiceLauncher.launchServiceRobustly(ServiceLauncher.java:475) at org.apache.slider.core.main.ServiceLauncher.launchServiceAndExit(ServiceLauncher.java:403) at org.apache.slider.core.main.ServiceLauncher.serviceMain(ServiceLauncher.java:630) at org.apache.slider.Slider.main(Slider.java:49) Caused by: java.net.BindException: Invalid yarn.resourcemanager.address value:0.0.0.0:8032 - see https://wiki.apache.org/hadoop/UnsetHostnameOrPort at org.apache.slider.client.SliderYarnClientImpl.serviceInit(SliderYarnClientImpl.java:81) at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)

I do not have yarn.resourcemanager.address deinfed since running as HA. I have yarn.resourcemanager.address.rm40, yarn.resourcemanager.address.rm34 and yarn.resourcemanager.ha.rm-ids set to rm40,rm34. The SliderYarnClientImpl.serviceInit calls SliderUtils.getRmAddress(conf) which if the property does not exist sets it to 0.0.0.0 The only slider code I have found that deals with HA is CredentialUtils which calls hadoop's HAUtils.

Is there a configuration setting I'm missing?

Thanks

6 REPLIES 6
Highlighted

Re: slider HA error "Invalid yarn.resourcemanager.address value:0.0.0.0:8032"

Rising Star

Usually I see this error when Slider cannot find the HADOOP_CONF_DIR. It's falling back on the default value for yarn.resourcemanager.address. Do you have HADOOP_CONF_DIR set in slider-env.sh?

Re: slider HA error "Invalid yarn.resourcemanager.address value:0.0.0.0:8032"

Explorer

I would agree if the cluster was not HA. There is no yarn.resourcemanager.address property for HA

Re: slider HA error "Invalid yarn.resourcemanager.address value:0.0.0.0:8032"

Explorer

It seems SliderUtils.getRmAddress conf is calling Configuration.getSocketAddr rather then YarnConfiguration.getSocketAddr. The YarnConfiguration does the HA enabled check and will use the yarn.resourcemanager.address.rm30 property

Now to figure out why the YarnConfiguration is not being used.

Re: slider HA error "Invalid yarn.resourcemanager.address value:0.0.0.0:8032"

Explorer

Solved:

We are using slider-client.xml. Turns out that in addition to the properties listed in https://slider.incubator.apache.org/docs/high_availability.html you need

yarn.resourcemanager.webapp.address.<rmid>

yarn.resourcemanager.resource-tracker.address.<rmid>

yarn.resourcemanager.admin.address.<rmid>

Re: slider HA error "Invalid yarn.resourcemanager.address value:0.0.0.0:8032"

Explorer

only needed yarn.resourcemanager.ha.id

Re: slider HA error "Invalid yarn.resourcemanager.address value:0.0.0.0:8032"

Expert Contributor

@sarah - i seem to be getting the same error when i try to start HiveInteractive 2..

from your note above, seems i need to add property - yarn.resourcemanager.ha.id in slider-client.xml ?

what should the value of this property be ?

Pls note -

yarn.resourcemanager.ha.enabled - is set to false

Don't have an account?
Coming from Hortonworks? Activate your account here