question Re: How can we Find long running jobs in hadoop cluster? in Archives of Support Questions (Read Only)

How can we Find long running jobs in hadoop cluster?

ppavan10 — Fri, 16 Sep 2022 11:53:15 GMT

Re: How can we Find long running jobs in hadoop cluster?

gnovak — Wed, 05 Jul 2017 20:04:21 GMT

What kind of jobs exactly are you looking for? For example you can find long running YARN applications on the ResourceManager UI: select running applications (<RM address>:8088/cluster/apps/RUNNING) and sort by StartTime.

Re: How can we Find long running jobs in hadoop cluster?

ppavan10 — Wed, 05 Jul 2017 20:39:37 GMT

in terms of resource utilization

Re: How can we Find long running jobs in hadoop cluster?

manish1 — Wed, 05 Jul 2017 23:57:49 GMT

@pavan p

As gnovak mentioned, you can track long running jobs from ResourceManager UI. Here are the steps:

1. Login to Ambari

2. Click on YARN (under Services)

3. Click on Quick Links

4. Click on resource Manager UI

5. By default you will see a list of all submitted jobs

6. Click on "Jobs -> Running" from left hand side menu. It will show you all jobs which are running currently.

7. Then click on sort by StartTime.

Please let me know if it works for you.

Re: How can we Find long running jobs in hadoop cluster?

ppavan10 — Thu, 06 Jul 2017 09:41:57 GMT

how can we identify a job taking more resources than allocation?