Created 06-07-2017 08:14 AM
Created on 06-08-2017 05:57 AM - edited 08-17-2019 10:41 PM
You can refer to the following Doc to know the NameNode Heap recommendations based on number of files;
.
Created on 06-07-2017 08:21 AM - edited 08-17-2019 10:41 PM
From Ambari UI --> HDFS --> Configs --> Advanced --> NameNode --> NameNode New Generation Size & NameNode maximum new generation size
.
Created on 06-08-2017 05:54 AM - edited 08-17-2019 10:41 PM
Thanks Jay.
I am confused to set the parameters into the Ambari.
Lets, the already set parameter into the Ambari is below:
Now I want to set the new parameters, Condition below:
a) Namenode is going to have more than 8 million files
So, I need to configure java heap with new generation heap and max new gen heap for Namenode heap size.
Created on 06-08-2017 05:57 AM - edited 08-17-2019 10:41 PM
You can refer to the following Doc to know the NameNode Heap recommendations based on number of files;
.
Created 06-08-2017 06:45 AM
Thanks Jay,
But I am but confused to fill the values in below fields.
Can you help me please for it,
NameNode new generation size =? MB
NameNode maximum new generation size = ? MB
NameNode permanent generation size = ? MB
NameNode maximum permanent generation size = ? MB
Created 06-08-2017 06:54 AM
You can set:
NameNode new generation size = 768 NameNode maximum new generation size = 768
.
Permanent Generation values you can leave default. Because from JDK 1.8 onwards there is no concept of Permanent Generation it is replaced with the MetaSpace.
Created 06-08-2017 07:32 AM
Thanks Jay