Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Which MRv2/YARN daemons is the one responsible for launching application containers and monitoring application resource usage.

Solved Go to solution
Highlighted

Which MRv2/YARN daemons is the one responsible for launching application containers and monitoring application resource usage.

Rising Star

is it the NodeManager? Is it the ApplicationMaster?

As per the Hadoop Definitive guide-

1. The client, which submits the MapReduce Job

2.The YARN Resource manager, which coordinates the allocation of the compute resources on the cluster

3.The YARN Node Managers, which launch and monitor the compute containers on machines on the cluster

4. The MapReduce ApplicationMaster, which co-ordinates the task running the MapReduce job. The application master and the MapReduce tasks run in container that are scheduled by RM and managed by NM.

From what I understand it should the Node Manager but I am not sure. Can anyone clarify on this please. Thanks.

1 ACCEPTED SOLUTION

Accepted Solutions

Re: Which MRv2/YARN daemons is the one responsible for launching application containers and monitoring application resource usage.

Yes, the NodeManager is responsible for launching application containers. The NodeManager also has the capability to monitor resource consumption by the containers it launches, and terminate them if they exceed their allocated resource utilization.

2 REPLIES 2

Re: Which MRv2/YARN daemons is the one responsible for launching application containers and monitoring application resource usage.

Yes, the NodeManager is responsible for launching application containers. The NodeManager also has the capability to monitor resource consumption by the containers it launches, and terminate them if they exceed their allocated resource utilization.

Re: Which MRv2/YARN daemons is the one responsible for launching application containers and monitoring application resource usage.

Rising Star

Thank Chris

Don't have an account?
Coming from Hortonworks? Activate your account here