Support Questions

Find answers, ask questions, and share your expertise

Hadoop cluster planning

Explorer

Any documents like Hadoop cluster planning mode like pro with the important ecosystems & services

3 REPLIES 3

Super Mentor

@Manoj Menon

We have "HDP Cluster Planning Guide" documentation link available as part of HDP documentation, hope that is what you are looking out for.

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.0/bk_cluster-planning/content/ch_hardware-rec...

Explorer

Thanks jay sharma. But if there is any documents which look likes a professional hadoop cluster in a corporate environment with majority of Important services like NN,DN,zookeeper,Hbase,Hive,oozie,sqoop like .. How to assign RAM,storage...

Super Mentor

@Manoj Menon

Every environment runs different kind of job and has different hardware. The kind of job, how many hadoop components are you running, which kind of HDP components are involved in the HDP cluster, behaviour of jobs, frequency of job execution etc are completely different hence the values for RAM and storage differes.

However if you want a generic guidelines for RAM/Storage then you can refer to the following docs:

1. Determining HDP Memory Configuration Settings
https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.0/bk_command-line-installation/content/determ...

2. Configuring NameNode Heap Size:
https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.0/bk_command-line-installation/content/config...

3. Hardware Planning on Slave & Master Nodes:
https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.3/bk_cluster-planning/content/hardware-for-sl...
https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.3/bk_cluster-planning/content/hardware-select...

Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.