Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Data Node heap size warning

Solved Go to solution

Data Node heap size warning

Expert Contributor

Hi,

I am using a HDP 2.4.2 cluster, since yesterday few of my datanodes heap size has been up continuously even when there are no jobs running. I have seen this article:

https://community.hortonworks.com/articles/74076/datanode-high-heap-size-alert.html

but not sure where exactly to make these changes??

do i go to hadoop-env template on ambari and change the HADOOP_DATANODE_OPTS=...

And once i do it, do i need to restart the HDFS service??

Thanks.

1 ACCEPTED SOLUTION

Accepted Solutions

Re: Data Node heap size warning

@PJ

Yes, your correct. you can modify HADOOP_DATANODE_OPTS parameters. Ambari will prompt if Restart is required. In this case, yes restart is needed

4 REPLIES 4

Re: Data Node heap size warning

@PJ

Yes, your correct. you can modify HADOOP_DATANODE_OPTS parameters. Ambari will prompt if Restart is required. In this case, yes restart is needed

Re: Data Node heap size warning

@apappu is correct. These JVM options should be added to HADOOP_DATANODE_OPTS in the hadoop-env template.

After making the changes you should restart all the DataNodes (there is no need to restart the NameNodes). I recommend restarting DataNodes two at a time.

Highlighted

Re: Data Node heap size warning

New Contributor

Attempts to view that article result in an access denied error.

Re: Data Node heap size warning

Expert Contributor

Yes, I applied those parameter settings and all alerts are gone within few minutes. Thanks all.