Reply
Explorer
Posts: 7
Registered: ‎11-16-2016

yarn application always in pending

hello 

 

we now have a issue is our yarn application which running on cloudera platform  can not run over two applications.

 

未命名5.png

 

I think the issue is due to the memory.

 

These two application use the all memory and the 3rd application can not start process

 

How can I set the memory size by cloudera management Web UI?

Champion
Posts: 545
Registered: ‎05-16-2016

Re: yarn application always in pending

Hi

 

the below link - will walk through in configuring Dynamic Resource pooling in Cloudera manager .

 

https://www.cloudera.com/documentation/enterprise/5-6-x/topics/cm_mc_resource_pools.html

Posts: 630
Topics: 3
Kudos: 102
Solutions: 66
Registered: ‎08-16-2016

Re: yarn application always in pending

This has to do with the YARN memory settings.  The amount of memory allocated to yarn is only 8 GB.  I don't know what the minimum container size is, probably around 1.3 G.  That combination of the two determine the amount of containers that can be launched.  The result of that for your cluster is 6 containers.  Anything beyond that will have to wait for resources to be freed up.

 

https://hortonworks.com/blog/how-to-plan-and-configure-yarn-in-hdp-2-0/

https://www.cloudera.com/documentation/enterprise/5-3-x/topics/cdh_ig_yarn_tuning.html

Announcements