Reply
Explorer
Posts: 20
Registered: ‎12-27-2018

Re: Unable to start YARN - NodeManager on role NodeManager

Hi Li,

 

Everything on a single node.

 

/opt/cloudera/parcels/CDH/lib/hadoop-yarn/bin
[root@optim-rhel72-uppu bin]# ls -lrt
total 80
-rwxr-xr-x 1 root root 12476 May 24  2018 yarn
-rwxr-xr-x 1 root root  5463 May 24  2018 mapred
---Sr-s--- 1 root yarn 53712 May 24  2018 container-executor

 

This is the error from /var/log/hadoop-yarn/hadoop-cmf-yarn-NODEMANAGER-optim-rhel72-uppu.development.unicomglobal.software.log.out

 

2019-01-30 23:42:45,872 INFO org.apache.hadoop.service.AbstractService: Service NodeManager failed in state INITED; cause: org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Failed to initialize container executor
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Failed to initialize container executor
        at org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceInit(NodeManager.java:269)
        at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
        at org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:562)
        at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:609)
Caused by: java.io.IOException: Cannot run program "/opt/cloudera/parcels/CDH-5.15.0-1.cdh5.15.0.p0.21/lib/hadoop-yarn/bin/container-executor": error=13, Permission denied

 

Thanks,

Tulasi

Posts: 932
Kudos: 28
Solutions: 16
Registered: ‎05-27-2014

Re: Unable to start YARN - NodeManager on role NodeManager

Hi @Tulasi,

 

Could you please run below command and send us the output?

id yarn

 

Thanks,

Li

Li Wang, Technical Resolution Manager


Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.

Learn more about the Cloudera Community:

Terms of Service

Community Guidelines

How to use the forum

Explorer
Posts: 20
Registered: ‎12-27-2018

Re: Unable to start YARN - NodeManager on role NodeManager

Hi Li,

 

This is what I am getting:

 

[root@optim-rhel72-uppu ~]# id yarn
uid=1007(yarn) gid=1010(hadoop) groups=1010(hadoop)

 

Thanks,

Tulasi

Contributor
Posts: 58
Registered: ‎04-26-2017

Re: Unable to start YARN - NodeManager on role NodeManager

Is nosuid set on the mount point?  I had a simialr issue documented here: http://community.cloudera.com/t5/Cloudera-Manager-Installation/URGENT-Cluster-unavailable-after-upgr...

Explorer
Posts: 20
Registered: ‎12-27-2018

Re: Unable to start YARN - NodeManager on role NodeManager

This is the content of my /etc/fstab file

-----------------------------------

/dev/mapper/rhel_rhel72-root /                       xfs     defaults        0 0
UUID=d762b842-5c87-4e4d-bc0e-7a6bad357604 /boot                   xfs     defaults        0 0
/dev/mapper/rhel_rhel72-home /home                   xfs     defaults        0 0
/dev/mapper/rhel_rhel72-swap swap                    swap    defaults        0 0

 

 -----------------------------------

Do I need to change anything?

 

Thanks.

Posts: 932
Kudos: 28
Solutions: 16
Registered: ‎05-27-2014

Re: Unable to start YARN - NodeManager on role NodeManager

Hi @Tulasi,

 

Sorry for my late reply. From the output you sent below:

 

[root@optim-rhel72-uppu ~]# id yarn
uid=1007(yarn) gid=1010(hadoop) groups=1010(hadoop)

 

This looks a little different than my test cluster. Can you please do this?

usermod -g yarn yarn
usermod -a -G hadoop yarn

 

Also, please paste the content of this file:

/opt/cloudera/parcels/CDH/meta/permissions.json

 

Thanks,

Li 

Li Wang, Technical Resolution Manager


Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.

Learn more about the Cloudera Community:

Terms of Service

Community Guidelines

How to use the forum

Highlighted
Explorer
Posts: 20
Registered: ‎12-27-2018

Re: Unable to start YARN - NodeManager on role NodeManager

Hi Li,

 

Thanks for being on top of it and helping me in solving the problem.

 

usermod -g yarn yarn

usermod -a -G hadoop yarn

 

Above two commands fixed my problem.

[root@optim-rhel72-uppu meta]# id yarn
uid=1007(yarn) gid=1008(yarn) groups=1008(yarn),1010(hadoop)

 

I have no idea how yarn user permissions are changed, all that I am following is that what have been suggested in cloudera instructions to enable encryption.

 

Thanks to all of the folks for providing suggestions.

 

Problems like this sucks lot of time in identifying where to fix and I would request cloudera to improve such situations.

 

Thanks,

Tulasi

 

 

Posts: 932
Kudos: 28
Solutions: 16
Registered: ‎05-27-2014

Re: Unable to start YARN - NodeManager on role NodeManager

Hi @Tulasi,

 

Greate to hear the issue got resolved! I will report internally on this to our documentation team to see how we can improve on it.

 

Thanks,

Li

Li Wang, Technical Resolution Manager


Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.

Learn more about the Cloudera Community:

Terms of Service

Community Guidelines

How to use the forum

Announcements