Support Questions

Find answers, ask questions, and share your expertise

Which MRv2/YARN daemons is the one responsible for launching application containers and monitoring application resource usage.

avatar
Expert Contributor

is it the NodeManager? Is it the ApplicationMaster?

As per the Hadoop Definitive guide-

1. The client, which submits the MapReduce Job

2.The YARN Resource manager, which coordinates the allocation of the compute resources on the cluster

3.The YARN Node Managers, which launch and monitor the compute containers on machines on the cluster

4. The MapReduce ApplicationMaster, which co-ordinates the task running the MapReduce job. The application master and the MapReduce tasks run in container that are scheduled by RM and managed by NM.

From what I understand it should the Node Manager but I am not sure. Can anyone clarify on this please. Thanks.

1 ACCEPTED SOLUTION

avatar

Yes, the NodeManager is responsible for launching application containers. The NodeManager also has the capability to monitor resource consumption by the containers it launches, and terminate them if they exceed their allocated resource utilization.

View solution in original post

2 REPLIES 2

avatar

Yes, the NodeManager is responsible for launching application containers. The NodeManager also has the capability to monitor resource consumption by the containers it launches, and terminate them if they exceed their allocated resource utilization.

avatar
Expert Contributor

Thank Chris