Created on 06-21-2017 07:41 PM - edited 09-16-2022 04:48 AM
hello
we now have a issue is our yarn application which running on cloudera platform can not run over two applications.
I think the issue is due to the memory.
These two application use the all memory and the 3rd application can not start process
How can I set the memory size by cloudera management Web UI?
Created 06-22-2017 02:04 AM
Hi
the below link - will walk through in configuring Dynamic Resource pooling in Cloudera manager .
https://www.cloudera.com/documentation/enterprise/5-6-x/topics/cm_mc_resource_pools.html
Created 06-23-2017 06:30 AM
This has to do with the YARN memory settings. The amount of memory allocated to yarn is only 8 GB. I don't know what the minimum container size is, probably around 1.3 G. That combination of the two determine the amount of containers that can be launched. The result of that for your cluster is 6 containers. Anything beyond that will have to wait for resources to be freed up.
https://hortonworks.com/blog/how-to-plan-and-configure-yarn-in-hdp-2-0/
https://www.cloudera.com/documentation/enterprise/5-3-x/topics/cdh_ig_yarn_tuning.html
 
					
				
				
			
		
