Things to consider before using DominanatResourceCalculator for Scheduling in HDP 2.4.0.0

[#1]

Currently we are using DefaultResourceCalculator and planning to change that to DominanatResourceCalculator in HDP 2.4.0.0. Are there any challenges or known issues which we need to aware of before doing this change and also is it fully supported in the HDP version we are using.

If so, what is the recommended values/formula to use to calculate below parameters.

Percentage of physical CPU allocated for all containers on a node & Number of virtual cores

[#2 · Accepted solution]

Here is a great blog on Dominant Resource Calculator by Varun Vasudev that you can reference.

http://hortonworks.com/blog/managing-cpu-resources-in-your-hadoop-yarn-clusters/

[#3]

Thanks @Binu Mathew