question Re: Node Manager stops after few moment in Archives of Support Questions (Read Only)

Node Manager stops after few moment

subhashguptasub — Sat, 02 Sep 2017 18:28:36 GMT

Getting the below error

ERROR org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Unexpected error starting NodeStatusUpdater
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved SHUTDOWN signal from Resourcemanager ,Registration of NodeManager failed, Message from ResourceManager: NodeManager from ubuntu-VirtualBox doesn't satisfy minimum allocations, Sending SHUTDOWN signal to the NodeManager.

Re: Node Manager stops after few moment

sandyy006 — Sat, 02 Sep 2017 19:49:47 GMT

@Subhas Gupta

Looks like you don't have enough resources. Do check the resource allocations and reduce them if you can.

Re: Node Manager stops after few moment

subhashguptasub — Sat, 02 Sep 2017 20:03:36 GMT

@Sandeep Nemuri

I am a beginer and just installed the hadoop and testing jps command first time then seeing that all 6 resources are running and hit the jps second time then seeing node manger is missing.

could you please explain me in detail so that i can solve this issue.. Thanks

Re: Node Manager stops after few moment

shivkumar82015 — Sun, 03 Sep 2017 19:06:43 GMT

As sandeep said its issue to resource as you have updated same in error "NodeManager from ubuntu-VirtualBox doesn't satisfy minimum allocations,".

To get some understanding read below, definitely you some idea.

https://mapr.com/blog/best-practices-yarn-resource-management/

Re: Node Manager stops after few moment

AshishVarma — Sat, 03 Apr 2021 20:46:54 GMT

Check the heap assigned for the node manager

in the hadoop/etc/hadoop/yarn-env.sh define the heap for node manager

JAVA=$JAVA_HOME/bin/java JAVA_HEAP_MAX=-Xmx256m # For setting YARN specific HEAP sizes please use this # Parameter and set appropriately YARN_HEAPSIZE=256

After that, you can configure the resources in yarn-site.xml

<configuration> <property> <name>yarn.nodemanager.aux-services</name> <value>mapreduce_shuffle</value> </property> <property> <name>yarn.scheduler.minimum-allocation-mb</name> <value>2000</value> </property> <property> <name>yarn.scheduler.minimum-allocation-vcores</name> <value>1</value> </property> <property> <name>yarn.nodemanager.resource.memory-mb</name> <value>2000</value> </property> <property> <name>yarn.nodemanager.resource.cpu-vcores</name> <value>1</value> </property> </configuration>

please like and confirm if it helps

Thanks

Ashish