Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

How can we Find long running jobs in hadoop cluster?

Solved Go to solution
Highlighted

How can we Find long running jobs in hadoop cluster?

New Contributor
 
1 ACCEPTED SOLUTION

Accepted Solutions

Re: How can we Find long running jobs in hadoop cluster?

Expert Contributor

@pavan p

As gnovak mentioned, you can track long running jobs from ResourceManager UI. Here are the steps:

1. Login to Ambari

2. Click on YARN (under Services)

3. Click on Quick Links

4. Click on resource Manager UI

5. By default you will see a list of all submitted jobs

6. Click on "Jobs -> Running" from left hand side menu. It will show you all jobs which are running currently.

7. Then click on sort by StartTime.

Please let me know if it works for you.

4 REPLIES 4

Re: How can we Find long running jobs in hadoop cluster?

Expert Contributor

@pavan p

What kind of jobs exactly are you looking for? For example you can find long running YARN applications on the ResourceManager UI: select running applications (<RM address>:8088/cluster/apps/RUNNING) and sort by StartTime.

Re: How can we Find long running jobs in hadoop cluster?

New Contributor

in terms of resource utilization

Re: How can we Find long running jobs in hadoop cluster?

Expert Contributor

@pavan p

As gnovak mentioned, you can track long running jobs from ResourceManager UI. Here are the steps:

1. Login to Ambari

2. Click on YARN (under Services)

3. Click on Quick Links

4. Click on resource Manager UI

5. By default you will see a list of all submitted jobs

6. Click on "Jobs -> Running" from left hand side menu. It will show you all jobs which are running currently.

7. Then click on sort by StartTime.

Please let me know if it works for you.

Re: How can we Find long running jobs in hadoop cluster?

New Contributor

how can we identify a job taking more resources than allocation?

Don't have an account?
Coming from Hortonworks? Activate your account here