Data Node heap size warning

[#1]

Hi,

I am using a HDP 2.4.2 cluster, since yesterday few of my datanodes heap size has been up continuously even when there are no jobs running. I have seen this article:

https://community.hortonworks.com/articles/74076/datanode-high-heap-size-alert.html

but not sure where exactly to make these changes??

do i go to hadoop-env template on ambari and change the HADOOP_DATANODE_OPTS=...

And once i do it, do i need to restart the HDFS service??

Thanks.

[#2 · Accepted solution]

@PJ

Yes, your correct. you can modify HADOOP_DATANODE_OPTS parameters. Ambari will prompt if Restart is required. In this case, yes restart is needed

[#3]

@apappu is correct. These JVM options should be added to HADOOP_DATANODE_OPTS in the hadoop-env template.

After making the changes you should restart all the DataNodes (there is no need to restart the NameNodes). I recommend restarting DataNodes two at a time.

[#4]

Attempts to view that article result in an access denied error.

[#5]

Yes, I applied those parameter settings and all alerts are gone within few minutes. Thanks all.