question Re: Things to consider before using DominanatResourceCalculator for Scheduling in HDP 2.4.0.0 in Support Questions

Things to consider before using DominanatResourceCalculator for Scheduling in HDP 2.4.0.0

sparepally — Fri, 02 Dec 2016 04:08:13 GMT

Currently we are using DefaultResourceCalculator and planning to change that to DominanatResourceCalculator in HDP 2.4.0.0. Are there any challenges or known issues which we need to aware of before doing this change and also is it fully supported in the HDP version we are using.

If so, what is the recommended values/formula to use to calculate below parameters.

Percentage of physical CPU allocated for all containers on a node & Number of virtual cores

Re: Things to consider before using DominanatResourceCalculator for Scheduling in HDP 2.4.0.0

bmathew — Fri, 02 Dec 2016 04:42:10 GMT

Here is a great blog on Dominant Resource Calculator by Varun Vasudev that you can reference.

http://hortonworks.com/blog/managing-cpu-resources-in-your-hadoop-yarn-clusters/

Re: Things to consider before using DominanatResourceCalculator for Scheduling in HDP 2.4.0.0

sparepally — Fri, 02 Dec 2016 05:16:06 GMT

Thanks @Binu Mathew