Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Namenode Memory Sizing

Highlighted

Namenode Memory Sizing

New Contributor

Hi

I appreciate if someone can help me understand how to optimize memory for Namenode.

Assuming you have a default 1GB of RAM for initial 1TB of data, with time if the data size reached to 100TB, how do you calculate the appropriate increase in NameNode RAM to accommodate the new capacity. Also what parameters in Ambari config should you adjust the new heap value?

I am able to understand how the below article when it comes to file numbers but not when it comes to data sizes.

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.5/bk_command-line-installation/content/config...

https://community.hortonworks.com/articles/14170/namenode-garbage-collection-configuration-best-pra....

Let's assume the cluster has 3 master and 3 worker nodes, I appreciate any suggestion, comment and direction in this topic as it is driving me crazy :)

Regards