Reply
New Contributor
Posts: 5
Registered: ‎09-17-2017

Long running jobs

Hi Team,

 

Is there any mechanism in identifying the long running jobs (yarn, Spark or hive) from chart builder, now i am running script to identify those. Please let us know is there any possibility of getting data of long running jobs to criculate the same to whole team.

 

Regards

Chaitanya 

Highlighted
Explorer
Posts: 15
Registered: ‎05-22-2017

Re: Long running jobs

Hi,

I could find charts below in [YARN > Charts Library].

(cloudera MANAGER version: Cloudera Express 5.13.0)

- Applications Running For Less Than 60 Minutes Across YARN Pools
SELECT apps_running_within_60_mins_across_yarn_pools WHERE entityName = "yarn" AND category = SERVICE

- Applications Running For Between 60 and 300 Minutes Across YARN Pools
SELECT apps_running_between_60to300_mins_across_yarn_pools WHERE entityName = "yarn" AND category = SERVICE

- Applications Running For Between 300 and 1440 Minutes Across YARN Pools
SELECT apps_running_between_300to1440_mins_across_yarn_pools WHERE entityName = "yarn" AND category = SERVICE

- Applications Running For More Than 1440 Minutes Across YARN Pools
SELECT apps_running_over_1440_mins_across_yarn_pools WHERE entityName = "yarn" AND category = SERVICE

To identify who and what job is running, we should dig [YARN > Resource Pools] or RM Web UI I think.

 

I hope this helps.

New Contributor
Posts: 1
Registered: ‎03-14-2018

Re: Long running jobs

[ Edited ]

Hello Chaitanya,

 

Can you provide me the defination of the alert script for long running job that you're using?

 

Thanks,

 

New Contributor
Posts: 1
Registered: ‎04-24-2017

Re: Long running jobs

Hello,

 

Can it be possible to set the alerts for long running jobs?

 

Thank you

Bhanu

Announcements