Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

yarn application always in pending

avatar
Explorer

hello 

 

we now have a issue is our yarn application which running on cloudera platform  can not run over two applications.

 

未命名5.png

 

I think the issue is due to the memory.

 

These two application use the all memory and the 3rd application can not start process

 

How can I set the memory size by cloudera management Web UI?

2 REPLIES 2

avatar
Champion

Hi

 

the below link - will walk through in configuring Dynamic Resource pooling in Cloudera manager .

 

https://www.cloudera.com/documentation/enterprise/5-6-x/topics/cm_mc_resource_pools.html

avatar
Champion

This has to do with the YARN memory settings.  The amount of memory allocated to yarn is only 8 GB.  I don't know what the minimum container size is, probably around 1.3 G.  That combination of the two determine the amount of containers that can be launched.  The result of that for your cluster is 6 containers.  Anything beyond that will have to wait for resources to be freed up.

 

https://hortonworks.com/blog/how-to-plan-and-configure-yarn-in-hdp-2-0/

https://www.cloudera.com/documentation/enterprise/5-3-x/topics/cdh_ig_yarn_tuning.html