Long running jobs

[ChaitanyaManth]

Hi Team,

Is there any mechanism in identifying the long running jobs (yarn, Spark or hive) from chart builder, now i am running script to identify those. Please let us know is there any possibility of getting data of long running jobs to criculate the same to whole team.

Regards

Chaitanya 

[nfukuda]

Hi,

I could find charts below in [YARN > Charts Library].

(cloudera MANAGER version: Cloudera Express 5.13.0)

- Applications Running For Less Than 60 Minutes Across YARN Pools
SELECT apps_running_within_60_mins_across_yarn_pools WHERE entityName = "yarn" AND category = SERVICE

- Applications Running For Between 60 and 300 Minutes Across YARN Pools
SELECT apps_running_between_60to300_mins_across_yarn_pools WHERE entityName = "yarn" AND category = SERVICE

- Applications Running For Between 300 and 1440 Minutes Across YARN Pools
SELECT apps_running_between_300to1440_mins_across_yarn_pools WHERE entityName = "yarn" AND category = SERVICE

- Applications Running For More Than 1440 Minutes Across YARN Pools
SELECT apps_running_over_1440_mins_across_yarn_pools WHERE entityName = "yarn" AND category = SERVICE

To identify who and what job is running, we should dig [YARN > Resource Pools] or RM Web UI I think.

I hope this helps.

[reckonizeX]

Hello Chaitanya,

Can you provide me the defination of the alert script for long running job that you're using?

Thanks,

[clouderaguru]

Hello,

Can it be possible to set the alerts for long running jobs?

Thank you

Bhanu