question Re: NameNode Heap Usage (Daily) Alert in Archives of Support Questions (Read Only)

NameNode Heap Usage (Daily) Alert

rudrapbiswas — Tue, 13 Dec 2016 15:59:50 GMT

Last night I loaded some heavy amount of data to my hbase cluster . When I started my cluster today morning, it started throwing the above alert.

I tried to increase: namenode_opt_newsize, namenode_opt_maxnewsize, hbase_master_heapsize, hbase_master_xmn_size, metrics_collector_heapsize in AMS, but no luck.

Even I tried to 'expunge' the trash in namenode as well, but the alert still persists.

How can I get rid of this alert?

Re: NameNode Heap Usage (Daily) Alert

Former Member — Tue, 13 Dec 2016 16:06:46 GMT

@rudra prasad biswas

Increasing or decreasing the heap for those components will not help here. As NameNode Heap Usage (Daily) Alert is a watcher alert.

It watches growth rates of HDFS (in a days time) and if the threshold defined in the alert is reached then it triggers the warning/critical alert message. You should be able to edit the parameters values for this alert in

Ambari from Alerts (Tab) --> search for filter text 'NameNode Heap Usage' on the the 'Alert Definition Name' box.

Edit the alert threshold here.

Re: NameNode Heap Usage (Daily) Alert

rudrapbiswas — Tue, 13 Dec 2016 17:10:20 GMT

The definition of the alert says "This service-level alert is triggered if the NameNode heap usage deviation has grown beyond the specified threshold within a day period." Initially I had configured "Growth Rate" 50% (CRIT) and 20% (WARN). Now I increased the CRIT value to 60%. Is that the right way to resolve it or I need to try somewhere else?

Re: NameNode Heap Usage (Daily) Alert

avijayan — Wed, 14 Dec 2016 04:58:27 GMT

That is the correct place to change.

Re: NameNode Heap Usage (Daily) Alert

chen-dian — Fri, 29 Oct 2021 03:11:15 GMT

大佬，我也遇到了这个问题，请问这个告警怎么消除呢？