Support Questions
Find answers, ask questions, and share your expertise
Announcements
Check out our newest addition to the community, the Cloudera Innovation Accelerator group hub.

How can we Find long running jobs in hadoop cluster?

Explorer
 
1 ACCEPTED SOLUTION

Expert Contributor

@pavan p

As gnovak mentioned, you can track long running jobs from ResourceManager UI. Here are the steps:

1. Login to Ambari

2. Click on YARN (under Services)

3. Click on Quick Links

4. Click on resource Manager UI

5. By default you will see a list of all submitted jobs

6. Click on "Jobs -> Running" from left hand side menu. It will show you all jobs which are running currently.

7. Then click on sort by StartTime.

Please let me know if it works for you.

View solution in original post

4 REPLIES 4

Expert Contributor

@pavan p

What kind of jobs exactly are you looking for? For example you can find long running YARN applications on the ResourceManager UI: select running applications (<RM address>:8088/cluster/apps/RUNNING) and sort by StartTime.

Explorer

in terms of resource utilization

Expert Contributor

@pavan p

As gnovak mentioned, you can track long running jobs from ResourceManager UI. Here are the steps:

1. Login to Ambari

2. Click on YARN (under Services)

3. Click on Quick Links

4. Click on resource Manager UI

5. By default you will see a list of all submitted jobs

6. Click on "Jobs -> Running" from left hand side menu. It will show you all jobs which are running currently.

7. Then click on sort by StartTime.

Please let me know if it works for you.

Explorer

how can we identify a job taking more resources than allocation?