TheApache Ambariproject is aimed at making Hadoop management simpler by developing software for provisioning, managing, and monitoringApacheHadoop clusters.Ambariprovides an intuitive, easy-to-use Hadoop management web UI backed by its RESTful APIs.
So the thing is, that we are trying to see if something is possible, by using Ambari. What we want to do is add extra nodes to a cluster whenever it gets overloaded beyond a certain point, and whenever the load goes to normal, we would like to remove the said extra nodes. As such we would ideally like to know via an email alert if the CPU/Memory of the datanodes are over a certain amount so that we can add the extra nodes in at the point. Is this possible, or even atleast approachable using Ambari?
Ambari allows us to add or remove nodes from the ambari cluster based on requirement.
- Ambari provides AMS (Ambari Metrics Collector) service for monitoring the Various components stats.
- For DataNode Service you can refer to the following Dashboard details:
Suppose I have cluster consisting of 1 high configuration master node on which are installed all the master components I need and two medium configuration machines which only have the components of DataNode and NodeManager. Now, from what I could tell, there is no "Alert" among the list of alerts that would notify me if my cluster CPU(By this I refer to only the datanodes) usage is above a certain percentage, so that it can send me an alert whenever it does go above it.
Sorry for late response. I saw another thread regarding your latest query. Responded there: