Support Questions

Find answers, ask questions, and share your expertise
Announcements
Check out our newest addition to the community, the Cloudera Data Analytics (CDA) group hub.

Long running jobs

New Contributor

Hi Team,

 

Is there any mechanism in identifying the long running jobs (yarn, Spark or hive) from chart builder, now i am running script to identify those. Please let us know is there any possibility of getting data of long running jobs to criculate the same to whole team.

 

Regards

Chaitanya 

3 REPLIES 3

Explorer

Hi,

I could find charts below in [YARN > Charts Library].

(cloudera MANAGER version: Cloudera Express 5.13.0)

- Applications Running For Less Than 60 Minutes Across YARN Pools
SELECT apps_running_within_60_mins_across_yarn_pools WHERE entityName = "yarn" AND category = SERVICE

- Applications Running For Between 60 and 300 Minutes Across YARN Pools
SELECT apps_running_between_60to300_mins_across_yarn_pools WHERE entityName = "yarn" AND category = SERVICE

- Applications Running For Between 300 and 1440 Minutes Across YARN Pools
SELECT apps_running_between_300to1440_mins_across_yarn_pools WHERE entityName = "yarn" AND category = SERVICE

- Applications Running For More Than 1440 Minutes Across YARN Pools
SELECT apps_running_over_1440_mins_across_yarn_pools WHERE entityName = "yarn" AND category = SERVICE

To identify who and what job is running, we should dig [YARN > Resource Pools] or RM Web UI I think.

 

I hope this helps.

New Contributor

Hello,

 

Can it be possible to set the alerts for long running jobs?

 

Thank you

Bhanu

New Contributor

Hello Chaitanya,

 

Can you provide me the defination of the alert script for long running job that you're using?

 

Thanks,

 

Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.