Support Questions

Find answers, ask questions, and share your expertise

I want to know the steps to Configure java heap with new generation heap and max new gen heap for Namenode heap size in the hortonworks

avatar
Contributor
 
1 ACCEPTED SOLUTION

avatar
Master Mentor

@Rahul Gupta

You can refer to the following Doc to know the NameNode Heap recommendations based on number of files;

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.4.0/bk_installing_manually_book/content/ref-809...

16139-nn-heap-size-recommendations.png

.

View solution in original post

6 REPLIES 6

avatar
Master Mentor

@Rahul Gupta

From Ambari UI --> HDFS --> Configs --> Advanced --> NameNode --> NameNode New Generation Size & NameNode maximum new generation size

16095-nn-heapsize.png

.

avatar
Contributor

Thanks Jay.

I am confused to set the parameters into the Ambari.

Lets, the already set parameter into the Ambari is below:

16146-previous.jpg

Now I want to set the new parameters, Condition below:

a) Namenode is going to have more than 8 million files

So, I need to configure java heap with new generation heap and max new gen heap for Namenode heap size.

avatar
Master Mentor

@Rahul Gupta

You can refer to the following Doc to know the NameNode Heap recommendations based on number of files;

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.4.0/bk_installing_manually_book/content/ref-809...

16139-nn-heap-size-recommendations.png

.

avatar
Contributor

Thanks Jay,

But I am but confused to fill the values in below fields.

Can you help me please for it,

NameNode new generation size =? MB

NameNode maximum new generation size = ? MB

NameNode permanent generation size = ? MB

NameNode maximum permanent generation size = ? MB

avatar
Master Mentor

@Rahul Gupta

You can set:

NameNode new generation size = 768
NameNode maximum new generation size = 768

.

Permanent Generation values you can leave default. Because from JDK 1.8 onwards there is no concept of Permanent Generation it is replaced with the MetaSpace.

https://dzone.com/articles/java-8-permgen-metaspace

avatar
Contributor

Thanks Jay