Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

yarn application always in pending

yarn application always in pending

Explorer

hello 

 

we now have a issue is our yarn application which running on cloudera platform  can not run over two applications.

 

未命名5.png

 

I think the issue is due to the memory.

 

These two application use the all memory and the 3rd application can not start process

 

How can I set the memory size by cloudera management Web UI?

2 REPLIES 2

Re: yarn application always in pending

Champion

Hi

 

the below link - will walk through in configuring Dynamic Resource pooling in Cloudera manager .

 

https://www.cloudera.com/documentation/enterprise/5-6-x/topics/cm_mc_resource_pools.html

Re: yarn application always in pending

Champion

This has to do with the YARN memory settings.  The amount of memory allocated to yarn is only 8 GB.  I don't know what the minimum container size is, probably around 1.3 G.  That combination of the two determine the amount of containers that can be launched.  The result of that for your cluster is 6 containers.  Anything beyond that will have to wait for resources to be freed up.

 

https://hortonworks.com/blog/how-to-plan-and-configure-yarn-in-hdp-2-0/

https://www.cloudera.com/documentation/enterprise/5-3-x/topics/cdh_ig_yarn_tuning.html