question Re: Update YARN resource pools using cm api in Support Questions

Update YARN resource pools using cm api

Prav — Fri, 16 Sep 2022 14:02:39 GMT

Hi Team,

Can anyone share if they have updated resource pool configurations in YARN using CM API, what end points were used if so. Thanks in advance.

Re: Update YARN resource pools using cm api

Prav — Wed, 09 Jan 2019 16:20:38 GMT

Specifically looking for :

Is this doable through the CM API?

Can I adjust the weights, memory, CPU of a Yarn resource pool?

Can I adjust create and delete pools?

Can I do the same allocations for Admission Control in Impala?

Re: Update YARN resource pools using cm api

Prav — Wed, 16 Jan 2019 17:15:14 GMT

Turns out, its a limitation as of now. Updates made to resource pools using CM API is known to break DRP UI. There are improvement tickets open internally with Cloudera to address that.

Re: Update YARN resource pools using cm api

Prav — Tue, 05 Mar 2019 15:20:06 GMT

Ways to change the pools via API today:

Use the PUT call of http://$HOSTNAME:7180/api/v19/clusters/<cluster>/services/<yarn>/config, to change yarn_fs_scheduled_allocations, followed by a POST to refresh pools (http://$HOSTNAME:7180/api/v19/clusters/<cluster>/commands/poolsRefresh)

Pros: It does update the pools, as desired. It does NOT affect the web UI
Cons: The JSON is complex and prone to typos. A typo could mess up all pools and cause issues on the cluster