Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

how to find the worker nodes that were used for a MR/Tez job

Highlighted

how to find the worker nodes that were used for a MR/Tez job

Expert Contributor

If i submit a job, i see only one worker node on the resource manager. I doubt all the data it is looking for is not on one host.

Is there a way to find what are the nodes a specific job used?

3 REPLIES 3

Re: how to find the worker nodes that were used for a MR/Tez job

Mentor

go through the job history and see which nodes processed the attempts. You need to open RM UI, then drill down to the job you want, history, task attempts, etc. @Raja Sekhar Chintalapati

Re: how to find the worker nodes that were used for a MR/Tez job

Guru

You can see the details on resource manager UI (http://rmhost:8088/ on typical setup). Look for the application that you are running, and you will which nodes the mappers and reduces run on.

Re: how to find the worker nodes that were used for a MR/Tez job

Mentor

@Raja Sekhar Chintalapati has this been resolved? Please accept best answer or provide your own solution.