question Re: I want to know the steps to Configure java heap with new generation heap and max new gen heap for Namenode heap size in the hortonworks in Archives of Support Questions (Read Only)

I want to know the steps to Configure java heap with new generation heap and max new gen heap for Namenode heap size in the hortonworks

rahul_gupta_ind — Wed, 07 Jun 2017 15:14:12 GMT

Re: I want to know the steps to Configure java heap with new generation heap and max new gen heap for Namenode heap size in the hortonworks

jsensharma — Sun, 18 Aug 2019 05:41:41 GMT

From Ambari UI --> HDFS --> Configs --> Advanced --> NameNode --> NameNode New Generation Size & NameNode maximum new generation size

Re: I want to know the steps to Configure java heap with new generation heap and max new gen heap for Namenode heap size in the hortonworks

rahul_gupta_ind — Sun, 18 Aug 2019 05:41:33 GMT

Thanks Jay.

I am confused to set the parameters into the Ambari.

Lets, the already set parameter into the Ambari is below:

Now I want to set the new parameters, Condition below:

a) Namenode is going to have more than 8 million files

So, I need to configure java heap with new generation heap and max new gen heap for Namenode heap size.

Re: I want to know the steps to Configure java heap with new generation heap and max new gen heap for Namenode heap size in the hortonworks

jsensharma — Sun, 18 Aug 2019 05:41:25 GMT

@Rahul Gupta

You can refer to the following Doc to know the NameNode Heap recommendations based on number of files;

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.4.0/bk_installing_manually_book/content/ref-80953924-1cbf-4655-9953-1e744290a6c3.1.html

Re: I want to know the steps to Configure java heap with new generation heap and max new gen heap for Namenode heap size in the hortonworks

rahul_gupta_ind — Thu, 08 Jun 2017 13:45:19 GMT

Thanks Jay,

But I am but confused to fill the values in below fields.

Can you help me please for it,

NameNode new generation size =? MB

NameNode maximum new generation size = ? MB

NameNode permanent generation size = ? MB

NameNode maximum permanent generation size = ? MB

Re: I want to know the steps to Configure java heap with new generation heap and max new gen heap for Namenode heap size in the hortonworks

jsensharma — Thu, 08 Jun 2017 13:54:09 GMT

@Rahul Gupta

You can set:

NameNode new generation size = 768
NameNode maximum new generation size = 768

Permanent Generation values you can leave default. Because from JDK 1.8 onwards there is no concept of Permanent Generation it is replaced with the MetaSpace.

https://dzone.com/articles/java-8-permgen-metaspace

Re: I want to know the steps to Configure java heap with new generation heap and max new gen heap for Namenode heap size in the hortonworks

rahul_gupta_ind — Thu, 08 Jun 2017 14:32:09 GMT

Thanks Jay