ambari cluster + alarm or notification in case os corrupted disk

[#1]

in our system we have more then 35 workers machines ,

we notice yesterday that one of the disk became write protected and the solution was to remount

during remount we see OS logs ( dmesg ) that fsck is needed on the disk /dev/sdc

because that , we want to know if some function in ambari cluster can verify or check the amari cluster machine and notify about this problem ( fsck is needed )

please advice how we can avoid such this cases and how ambari cluster can notify us about correpted disks

[#2 · Accepted solution]

@Michael Bronson

There are some limited predefined alerts available in terms of disk checking in ambari.

However ambari allows users to register their own custom alert definitions to fulfill their need. Following is an article that explains how we can register our own custom ambari alert and register it with Ambari to get custom alerts:

https://community.hortonworks.com/articles/38149/how-to-create-and-register-custom-ambari-alerts.htm...

.

Once the alert is setup and working we can either Setup Email Notification (OR) SNMP notification based on our requierment as described in :

https://community.hortonworks.com/articles/40361/how-to-troubleshoot-ambari-alerts-notification.html

https://docs.hortonworks.com/HDPDocuments/Ambari-2.6.0.0/bk_ambari-operations/content/creating_or_ed...

.