How can we avoid Resource Manager to retry failed Application Master on the same NodeManager?

stsudhakara — Fri, 16 Sep 2022 11:19:28 GMT

Can we avoid Resource Manager to retry failed Application Master on the same NodeManager? My hive job tried to lauch application master in same NM after multiple fails, It leads whole job fail after 4 retries.

Re: How can we avoid Resource Manager to retry failed Application Master on the same NodeManager?

stsudhakara — Thu, 30 Mar 2017 05:42:19 GMT

This response I got from the Cloudera support

"I can see you're running on CDH 5.3.3, and this was added as a feature in YARN-2005, which was included in CDH releases starting from CDH 5.5.0: "YARN-2005: Blacklisting support for scheduling AMs" https://issues.apache.org/jira/browse/YARN-2005,

Unfortunately this can't be backported to your version of CDH and you will have to resort to an upgrade "

Another ticket related black listing AMs is

https://issues.apache.org/jira/browse/YARN-4389

This fix releasing with Hadoop 2.8.0.

question How can we avoid Resource Manager to retry failed Application Master on the same NodeManager? in Archives of Support Questions (Read Only)

How can we avoid Resource Manager to retry failed Application Master on the same NodeManager?

Re: How can we avoid Resource Manager to retry failed Application Master on the same NodeManager?