Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]
Created 06-07-2017 08:14 AM
Created on 06-08-2017 05:57 AM - edited 08-17-2019 10:41 PM
You can refer to the following Doc to know the NameNode Heap recommendations based on number of files;
.
Created on 06-07-2017 08:21 AM - edited 08-17-2019 10:41 PM
From Ambari UI --> HDFS --> Configs --> Advanced --> NameNode --> NameNode New Generation Size & NameNode maximum new generation size
.
Created on 06-08-2017 05:54 AM - edited 08-17-2019 10:41 PM
Thanks Jay.
I am confused to set the parameters into the Ambari.
Lets, the already set parameter into the Ambari is below:
Now I want to set the new parameters, Condition below:
a) Namenode is going to have more than 8 million files
So, I need to configure java heap with new generation heap and max new gen heap for Namenode heap size.
Created on 06-08-2017 05:57 AM - edited 08-17-2019 10:41 PM
You can refer to the following Doc to know the NameNode Heap recommendations based on number of files;
.
Created 06-08-2017 06:45 AM
Thanks Jay,
But I am but confused to fill the values in below fields.
Can you help me please for it,
NameNode new generation size =? MB
NameNode maximum new generation size = ? MB
NameNode permanent generation size = ? MB
NameNode maximum permanent generation size = ? MB
Created 06-08-2017 06:54 AM
You can set:
NameNode new generation size = 768 NameNode maximum new generation size = 768
.
Permanent Generation values you can leave default. Because from JDK 1.8 onwards there is no concept of Permanent Generation it is replaced with the MetaSpace.
Created 06-08-2017 07:32 AM
Thanks Jay