Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Issue with Yarn jobs (accepted state due to AM container)

Solved Go to solution
Highlighted

Issue with Yarn jobs (accepted state due to AM container)

Rising Star

Hi,

We have an issue with yarn jobs and the number that can be run concurrently . There is a case that 6 TEZ jobs needs to be run concurrently but they all go to accepted state.

I uploaded the following information for your reference. I tried different configuration but still no luck. Please advise me

hive-site.xml under /usr/hdp/current/hive-server2/conf

Tex-site.xml under /usr/hdp/current/tez-client

Yarn-site.xml and Mapr-site.xml under /usr/hdp/current/hadoop-yarn-resourcemanager/etc/hadoop

Also

Yarn queue manager

Thanks

SJ

1 ACCEPTED SOLUTION

Accepted Solutions

Re: Issue with Yarn jobs (accepted state due to AM container)

Hi @Sanaz Janbakhsh,

Please try increasing the number of node managers and try running the jobs.

Also look for the parameters under Scheduler section of Yarn (yarn.scheduler.capacity.maximum-applications / yarn.scheduler.capacity.<queue-path>.maximum-application) and (yarn.scheduler.capacity.maximum-am-resource-percent / yarn.scheduler.capacity.<queue-path>.maximum-am-resource-percent) which will restrict the number of concurrent running and pending apps.

Please look at the link for more info.

https://hadoop.apache.org/docs/r2.7.3/hadoop-yarn/hadoop-yarn-site/CapacityScheduler.html

Thanks,

Aditya

3 REPLIES 3

Re: Issue with Yarn jobs (accepted state due to AM container)

Rising Star

Also please find the following attatch

acceptedjob.png

accpeted-application-in-rm-ui.png

Re: Issue with Yarn jobs (accepted state due to AM container)

Hi @Sanaz Janbakhsh,

Please try increasing the number of node managers and try running the jobs.

Also look for the parameters under Scheduler section of Yarn (yarn.scheduler.capacity.maximum-applications / yarn.scheduler.capacity.<queue-path>.maximum-application) and (yarn.scheduler.capacity.maximum-am-resource-percent / yarn.scheduler.capacity.<queue-path>.maximum-am-resource-percent) which will restrict the number of concurrent running and pending apps.

Please look at the link for more info.

https://hadoop.apache.org/docs/r2.7.3/hadoop-yarn/hadoop-yarn-site/CapacityScheduler.html

Thanks,

Aditya

Re: Issue with Yarn jobs (accepted state due to AM container)

Rising Star

Hi Aditya,

It was really helpful. Thanks.

Don't have an account?
Coming from Hortonworks? Activate your account here