question Yarn Application get Accepted state. in Archives of Support Questions (Read Only)

Yarn Application get Accepted state.

hoangletrung — Sun, 18 Aug 2019 11:18:19 GMT

When I running yarn app, I often get some app in queue( state ACCEPTED). But you can see I still have free resource.

So why app in queue ?

Re: Yarn Application get Accepted state.

rajkumar_singh — Wed, 21 Dec 2016 13:15:09 GMT

@Hoang Le if you look at the Max Application Master Resources,Used Application Master Resources both are same(4G), so this is hitting resource cap for application master and waiting to allocate Application Master container.

Re: Yarn Application get Accepted state.

hoangletrung — Wed, 21 Dec 2016 13:37:09 GMT

@Rajkumar Singh So how can I define Max Application Master Resources.

In default Configured Max Application Master Limit is set to 20%. If I increase figure, Max Application Master Resources increase. But how this Max Application Master Resources is calculated ?

Re: Yarn Application get Accepted state.

rajkumar_singh — Wed, 21 Dec 2016 13:41:40 GMT

@Hoang Le the maximum is calculated based on yarn.scheduler.capacity.maximum-am-resource-percent, seems you are launching am for one of the job which is configured to get 4GB of memory thats why you are seeing used am resources as 4GB which is the max-am-resource.

Re: Yarn Application get Accepted state.

hoangletrung — Sun, 18 Aug 2019 11:18:11 GMT

@Rajkumar Singh

I find this doc from hortonworks

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.3/bk_yarn-resource-management/content/setting_application_limits.html

and this from apache hadoop:

I know if I change yarn.scheduler.capacity.maximum-am-resource-percent then Max Application Master Resources will change. But I want to know which configure it depend to calculate.

For example if true I set yarn.scheduler.capacity.maximum-am-resource-percent = 1 (100%)

then Max Application Master Resources balance with yarn.nodemanager.resource.memory-mb

Re: Yarn Application get Accepted state.

rajkumar_singh — Wed, 21 Dec 2016 14:56:08 GMT

@Hoang Le this is to Get the maximum am resource percent per queue configured capacity. yarn.nodemanager.resource.memory-mb is the memory that a nodemanger announce to RM.