Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

On what basis Yarn RM chooses nodemanagers to assign containers

On what basis Yarn RM chooses nodemanagers to assign containers

New Contributor

Hi,

Could any one please let me know, how the Yarn RM chooses the nodemanagers to assign Yarn containers

1 REPLY 1
Highlighted

Re: On what basis Yarn RM chooses nodemanagers to assign containers

Contributor

@rmr1989

RM does not choose NMs to launch containers. It only launches the first container which is ApplicationMaster for the submitted application. RM also informs AM about the minimum and maximum resource capabilities of the cluster.

Then, it is Application Master's job to negotiate for resources. It will send a resource request to RM with a specfic number of containers on a specific node.

A ResourceRequest has the following form:

<resource-name, priority, resource-requirement, number-of-containers>

These components are described as follows:

resource-name is either hostname, rackname where the resource is desired, or * to indicate no preference.
priority is an intra-application priority for this request (not across multiple applications).This orders various ResourceRequests within a given application.
resource-requirement is the required capabilities such as the amount of memory or CPU time (currently YARN supports only memory and CPU).
number-of-containers is just a multiple of such containers. It limits the total number of containers as specified in the ResourceRequest.

Hope this helps !