Support Questions

Find answers, ask questions, and share your expertise

Yarn Resource Manager Vcores

New Contributor

I Have a question that i didnt understand about yarn,

If I have 3x Node Managers with 10 Cores

and I Set in Yarn Configuration that 10 vcores on each node can be allocated for containers,

so every 1vcore=1phy core?

because the server is using cores for other applications, so its not realistic that

all the 10 cores is using for containers.

1 REPLY 1

Super Collaborator

Did you check the tuning guide that we have for Yarn?

It takes all this into account when you follow the tuning guide.

 

Yarn uses vCores, in other words they are virtual cores and for simplicity we normally map 1 physical core, taking hyper threading into account, to somewhere between 1 and 4 virtual cores in Yarn.

 

Wilfred