Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

YARN cannot start

YARN cannot start

Rising Star

Two of our six nodemanagers wont start, failing with this erros on permissions.

I checked the dirctory, there is a root ownership on the container-executor.cfg and topology.map files, the other files are owner by yarn user.

 

But on other nodes, where the nodemanager sucessfully started, the permissions are the same, so I dont know why YARN cannot change the permission for these two files.

 

 

+ chmod go+r /var/run/cloudera-scm-agent/process/1240-yarn-NODEMANAGER /var/run/cloudera-scm-agent/process/1240-yarn-NODEMANAGER/cloudera-monitor.properties /var/run/cloudera-scm-agent/process/1240-yarn-NODEMANAGER/cloudera-stack-monitor.properties /var/run/cloudera-scm-agent/process/1240-yarn-NODEMANAGER/container-executor.cfg /var/run/cloudera-scm-agent/process/1240-yarn-NODEMANAGER/core-site.xml /var/run/cloudera-scm-agent/process/1240-yarn-NODEMANAGER/event-filter-rules.json /var/run/cloudera-scm-agent/process/1240-yarn-NODEMANAGER/hadoop-metrics2.properties /var/run/cloudera-scm-agent/process/1240-yarn-NODEMANAGER/hadoop-policy.xml /var/run/cloudera-scm-agent/process/1240-yarn-NODEMANAGER/hdfs-site.xml /var/run/cloudera-scm-agent/process/1240-yarn-NODEMANAGER/http-auth-signature-secret /var/run/cloudera-scm-agent/process/1240-yarn-NODEMANAGER/log4j.properties /var/run/cloudera-scm-agent/process/1240-yarn-NODEMANAGER/logs /var/run/cloudera-scm-agent/process/1240-yarn-NODEMANAGER/mapred-site.xml /var/run/cloudera-scm-agent/process/1240-yarn-NODEMANAGER/ssl-client.xml /var/run/cloudera-scm-agent/process/1240-yarn-NODEMANAGER/ssl-server.xml /var/run/cloudera-scm-agent/process/1240-yarn-NODEMANAGER/topology.map /var/run/cloudera-scm-agent/process/1240-yarn-NODEMANAGER/topology.py /var/run/cloudera-scm-agent/process/1240-yarn-NODEMANAGER/yarn.keytab /var/run/cloudera-scm-agent/process/1240-yarn-NODEMANAGER/yarn-site.xml
chmod: changing permissions of `/var/run/cloudera-scm-agent/process/1240-yarn-NODEMANAGER/container-executor.cfg': Operation not permitted
chmod: changing permissions of `/var/run/cloudera-scm-agent/process/1240-yarn-NODEMANAGER/topology.map': Operation not permitted
+ exec /opt/cloudera/parcels/CDH-5.2.0-1.cdh5.2.0.p0.36/lib/hadoop-yarn/bin/yarn nodemanager
4 REPLIES 4

Re: YARN cannot start

Contributor
What's the ownership of /var/run/cloudera-scm-agent/process/1240-yarn-NODEMANAGER/topology.map?

Re: YARN cannot start

Rising Star

The ownership was created during the launch of the application master, even after setting 777 on the parent directory the problem did not dissapear. We had to reinstall the whole cluster from screth :-(

 

Re: YARN cannot start

Master Guru
Did you use any form of LDAP integration in your environment when you hit this?

Re: YARN cannot start

Rising Star

Yes, LDAP was used. Currently LDAP is turned off.

 

Don't have an account?
Coming from Hortonworks? Activate your account here