question Re: Data Node heap size warning in Archives of Support Questions (Read Only)

Data Node heap size warning

pmj — Sat, 21 Jan 2017 05:00:34 GMT

Hi,

I am using a HDP 2.4.2 cluster, since yesterday few of my datanodes heap size has been up continuously even when there are no jobs running. I have seen this article:

https://community.hortonworks.com/articles/74076/datanode-high-heap-size-alert.html

but not sure where exactly to make these changes??

do i go to hadoop-env template on ambari and change the HADOOP_DATANODE_OPTS=...

And once i do it, do i need to restart the HDFS service??

Thanks.

Re: Data Node heap size warning

apappu — Sat, 21 Jan 2017 05:08:01 GMT

@PJ

Yes, your correct. you can modify HADOOP_DATANODE_OPTS parameters. Ambari will prompt if Restart is required. In this case, yes restart is needed

Re: Data Node heap size warning

ArpitAgarwal — Sat, 21 Jan 2017 06:15:57 GMT

@apappu is correct. These JVM options should be added to HADOOP_DATANODE_OPTS in the hadoop-env template.

After making the changes you should restart all the DataNodes (there is no need to restart the NameNodes). I recommend restarting DataNodes two at a time.

Re: Data Node heap size warning

pmj — Wed, 25 Jan 2017 23:26:32 GMT

Yes, I applied those parameter settings and all alerts are gone within few minutes. Thanks all.

Re: Data Node heap size warning

SteveSwartzl — Wed, 27 Sep 2017 17:51:13 GMT

Attempts to view that article result in an access denied error.