Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

How can we Find long running jobs in hadoop cluster?

avatar
Contributor
 
1 ACCEPTED SOLUTION

avatar
Super Collaborator

@pavan p

As gnovak mentioned, you can track long running jobs from ResourceManager UI. Here are the steps:

1. Login to Ambari

2. Click on YARN (under Services)

3. Click on Quick Links

4. Click on resource Manager UI

5. By default you will see a list of all submitted jobs

6. Click on "Jobs -> Running" from left hand side menu. It will show you all jobs which are running currently.

7. Then click on sort by StartTime.

Please let me know if it works for you.

View solution in original post

4 REPLIES 4

avatar
Expert Contributor

@pavan p

What kind of jobs exactly are you looking for? For example you can find long running YARN applications on the ResourceManager UI: select running applications (<RM address>:8088/cluster/apps/RUNNING) and sort by StartTime.

avatar
Contributor

in terms of resource utilization

avatar
Super Collaborator

@pavan p

As gnovak mentioned, you can track long running jobs from ResourceManager UI. Here are the steps:

1. Login to Ambari

2. Click on YARN (under Services)

3. Click on Quick Links

4. Click on resource Manager UI

5. By default you will see a list of all submitted jobs

6. Click on "Jobs -> Running" from left hand side menu. It will show you all jobs which are running currently.

7. Then click on sort by StartTime.

Please let me know if it works for you.

avatar
Contributor

how can we identify a job taking more resources than allocation?