question Re: Which MRv2/YARN daemons is the one responsible for launching application containers and monitoring application resource usage. in Archives of Support Questions (Read Only)

Which MRv2/YARN daemons is the one responsible for launching application containers and monitoring application resource usage.

GeeKay2015 — Tue, 29 Dec 2015 05:53:26 GMT

is it the NodeManager? Is it the ApplicationMaster?

As per the Hadoop Definitive guide-

1. The client, which submits the MapReduce Job

2.The YARN Resource manager, which coordinates the allocation of the compute resources on the cluster

3.The YARN Node Managers, which launch and monitor the compute containers on machines on the cluster

4. The MapReduce ApplicationMaster, which co-ordinates the task running the MapReduce job. The application master and the MapReduce tasks run in container that are scheduled by RM and managed by NM.

From what I understand it should the Node Manager but I am not sure. Can anyone clarify on this please. Thanks.

Re: Which MRv2/YARN daemons is the one responsible for launching application containers and monitoring application resource usage.

cnauroth — Tue, 29 Dec 2015 05:56:28 GMT

Yes, the NodeManager is responsible for launching application containers. The NodeManager also has the capability to monitor resource consumption by the containers it launches, and terminate them if they exceed their allocated resource utilization.

Re: Which MRv2/YARN daemons is the one responsible for launching application containers and monitoring application resource usage.

GeeKay2015 — Tue, 29 Dec 2015 09:28:27 GMT

Thank Chris