question Re: How to set alerts for yarn applications in Archives of Support Questions (Read Only)

How to set alerts for yarn applications

npdell — Fri, 16 Sep 2022 10:23:49 GMT

Hi ,

I would like to set up alerts ( mail alert) for the below events . How to achieve this using cloudera manager?

Whenever a job fails.

When a job is in Accepted state for more than 10 minutes.

Re: How to set alerts for yarn applications

roczei — Tue, 22 Nov 2016 10:38:05 GMT

Hello @npdell,

Cloudera Manager trigger is what you need. You can create it at here:

CM --> YARN --> Status --> Create trigger --> Edit manually

Examples:

1) It will alert if there are more than 50 applications in pending state

Expression:

IF (select total_apps_pending_across_yarn_pools WHERE entityName=$SERVICENAME and LAST( total_apps_pending_across_yarn_pools) > 50) DO health:concerning

Metric Evaluation Window: 10 minutes

2) It will alert if more than 5 applications are failing

Expression:

IF (select total_apps_failed_rate_across_yarn_pools WHERE entityName=$SERVICENAME and LAST( total_apps_failed_rate_across_yarn_pools) > 5) DO health:concerning

Here is the documentation about CM triggers:

http://www.cloudera.com/documentation/enterprise/latest/topics/cm_dg_triggers.html

Gabor

Re: How to set alerts for yarn applications

Bender — Wed, 27 Sep 2023 12:02:33 GMT

Maybe you can combine these two for a failed job alert:

My thought process is, that in the RM log, there is a very reliable pattern when a job fails (e.g. finalStatus=FAILED), so you could set up a Log Alert for that.