Created on 02-21-2018 05:05 AM - edited 09-16-2022 05:53 AM
Hi Team,
Is there any mechanism in identifying the long running jobs (yarn, Spark or hive) from chart builder, now i am running script to identify those. Please let us know is there any possibility of getting data of long running jobs to criculate the same to whole team.
Regards
Chaitanya
Created 03-05-2018 07:06 PM
Hi,
I could find charts below in [YARN > Charts Library].
(cloudera MANAGER version: Cloudera Express 5.13.0)
- Applications Running For Less Than 60 Minutes Across YARN Pools
SELECT apps_running_within_60_mins_across_yarn_pools WHERE entityName = "yarn" AND category = SERVICE
- Applications Running For Between 60 and 300 Minutes Across YARN Pools
SELECT apps_running_between_60to300_mins_across_yarn_pools WHERE entityName = "yarn" AND category = SERVICE
- Applications Running For Between 300 and 1440 Minutes Across YARN Pools
SELECT apps_running_between_300to1440_mins_across_yarn_pools WHERE entityName = "yarn" AND category = SERVICE
- Applications Running For More Than 1440 Minutes Across YARN Pools
SELECT apps_running_over_1440_mins_across_yarn_pools WHERE entityName = "yarn" AND category = SERVICE
To identify who and what job is running, we should dig [YARN > Resource Pools] or RM Web UI I think.
I hope this helps.
Created 10-26-2018 06:01 AM
Hello,
Can it be possible to set the alerts for long running jobs?
Thank you
Bhanu
Created on 03-14-2018 08:15 AM - edited 03-14-2018 08:15 AM
Hello Chaitanya,
Can you provide me the defination of the alert script for long running job that you're using?
Thanks,