Archives of Support Questions (Read Only)

This is an archived board for historical reference. Information and links may no longer be available or relevant
Announcements
This board is archived and read-only for historical reference. To ask a new question, please post a new topic on the appropriate active board.

How can we Find long running jobs in hadoop cluster?

avatar
New Member
 
1 ACCEPTED SOLUTION

avatar
Super Collaborator

@pavan p

As gnovak mentioned, you can track long running jobs from ResourceManager UI. Here are the steps:

1. Login to Ambari

2. Click on YARN (under Services)

3. Click on Quick Links

4. Click on resource Manager UI

5. By default you will see a list of all submitted jobs

6. Click on "Jobs -> Running" from left hand side menu. It will show you all jobs which are running currently.

7. Then click on sort by StartTime.

Please let me know if it works for you.

View solution in original post

4 REPLIES 4

avatar
Expert Contributor

@pavan p

What kind of jobs exactly are you looking for? For example you can find long running YARN applications on the ResourceManager UI: select running applications (<RM address>:8088/cluster/apps/RUNNING) and sort by StartTime.

avatar
New Member

in terms of resource utilization

avatar
Super Collaborator

@pavan p

As gnovak mentioned, you can track long running jobs from ResourceManager UI. Here are the steps:

1. Login to Ambari

2. Click on YARN (under Services)

3. Click on Quick Links

4. Click on resource Manager UI

5. By default you will see a list of all submitted jobs

6. Click on "Jobs -> Running" from left hand side menu. It will show you all jobs which are running currently.

7. Then click on sort by StartTime.

Please let me know if it works for you.

avatar
New Member

how can we identify a job taking more resources than allocation?