02-02-2017 02:14 PM
I Have a question that i didnt understand about yarn,
If I have 3x Node Managers with 10 Cores
and I Set in Yarn Configuration that 10 vcores on each node can be allocated for containers,
so every 1vcore=1phy core?
because the server is using cores for other applications, so its not realistic that
all the 10 cores is using for containers.
03-09-2017 04:19 PM
Did you check the tuning guide that we have for Yarn?
It takes all this into account when you follow the tuning guide.
Yarn uses vCores, in other words they are virtual cores and for simplicity we normally map 1 physical core, taking hyper threading into account, to somewhere between 1 and 4 virtual cores in Yarn.