Member since
09-02-2017
2
Posts
0
Kudos Received
0
Solutions
04-03-2021
01:46 PM
Check the heap assigned for the node manager in the hadoop/etc/hadoop/yarn-env.sh define the heap for node manager JAVA=$JAVA_HOME/bin/java
JAVA_HEAP_MAX=-Xmx256m
# For setting YARN specific HEAP sizes please use this
# Parameter and set appropriately
YARN_HEAPSIZE=256 After that, you can configure the resources in yarn-site.xml <configuration>
<property>
<name>yarn.nodemanager.aux-services</name>
<value>mapreduce_shuffle</value>
</property>
<property>
<name>yarn.scheduler.minimum-allocation-mb</name>
<value>2000</value>
</property>
<property>
<name>yarn.scheduler.minimum-allocation-vcores</name>
<value>1</value>
</property>
<property>
<name>yarn.nodemanager.resource.memory-mb</name>
<value>2000</value>
</property>
<property>
<name>yarn.nodemanager.resource.cpu-vcores</name>
<value>1</value>
</property>
</configuration> please like and confirm if it helps Thanks Ashish
... View more