Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Data Node heap size warning

avatar
Expert Contributor

Hi,

I am using a HDP 2.4.2 cluster, since yesterday few of my datanodes heap size has been up continuously even when there are no jobs running. I have seen this article:

https://community.hortonworks.com/articles/74076/datanode-high-heap-size-alert.html

but not sure where exactly to make these changes??

do i go to hadoop-env template on ambari and change the HADOOP_DATANODE_OPTS=...

And once i do it, do i need to restart the HDFS service??

Thanks.

1 ACCEPTED SOLUTION

avatar
hide-solution

This problem has been solved!

Want to get a detailed solution you have to login/registered on the community

Register/Login
4 REPLIES 4

avatar
hide-solution

This problem has been solved!

Want to get a detailed solution you have to login/registered on the community

Register/Login

avatar

@apappu is correct. These JVM options should be added to HADOOP_DATANODE_OPTS in the hadoop-env template.

After making the changes you should restart all the DataNodes (there is no need to restart the NameNodes). I recommend restarting DataNodes two at a time.

avatar

Attempts to view that article result in an access denied error.

avatar
Expert Contributor

Yes, I applied those parameter settings and all alerts are gone within few minutes. Thanks all.