Archives of Support Questions (Read Only)

This is an archived board for historical reference. Information and links may no longer be available or relevant
Announcements
This board is archived and read-only for historical reference. To ask a new question, please post a new topic on the appropriate active board.

I want to know the steps to Configure java heap with new generation heap and max new gen heap for Namenode heap size in the hortonworks

avatar
 
1 ACCEPTED SOLUTION

avatar
Master Mentor

@Rahul Gupta

You can refer to the following Doc to know the NameNode Heap recommendations based on number of files;

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.4.0/bk_installing_manually_book/content/ref-809...

16139-nn-heap-size-recommendations.png

.

View solution in original post

6 REPLIES 6

avatar
Master Mentor

@Rahul Gupta

From Ambari UI --> HDFS --> Configs --> Advanced --> NameNode --> NameNode New Generation Size & NameNode maximum new generation size

16095-nn-heapsize.png

.

avatar

Thanks Jay.

I am confused to set the parameters into the Ambari.

Lets, the already set parameter into the Ambari is below:

16146-previous.jpg

Now I want to set the new parameters, Condition below:

a) Namenode is going to have more than 8 million files

So, I need to configure java heap with new generation heap and max new gen heap for Namenode heap size.

avatar
Master Mentor

@Rahul Gupta

You can refer to the following Doc to know the NameNode Heap recommendations based on number of files;

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.4.0/bk_installing_manually_book/content/ref-809...

16139-nn-heap-size-recommendations.png

.

avatar

Thanks Jay,

But I am but confused to fill the values in below fields.

Can you help me please for it,

NameNode new generation size =? MB

NameNode maximum new generation size = ? MB

NameNode permanent generation size = ? MB

NameNode maximum permanent generation size = ? MB

avatar
Master Mentor

@Rahul Gupta

You can set:

NameNode new generation size = 768
NameNode maximum new generation size = 768

.

Permanent Generation values you can leave default. Because from JDK 1.8 onwards there is no concept of Permanent Generation it is replaced with the MetaSpace.

https://dzone.com/articles/java-8-permgen-metaspace

avatar

Thanks Jay