Hadoop cluster planning

[#1]

Any documents like Hadoop cluster planning mode like pro with the important ecosystems & services

[#2]

@Manoj Menon

We have "HDP Cluster Planning Guide" documentation link available as part of HDP documentation, hope that is what you are looking out for.

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.0/bk_cluster-planning/content/ch_hardware-rec...

[#3]

Thanks jay sharma. But if there is any documents which look likes a professional hadoop cluster in a corporate environment with majority of Important services like NN,DN,zookeeper,Hbase,Hive,oozie,sqoop like .. How to assign RAM,storage...

[#4]

@Manoj Menon

Every environment runs different kind of job and has different hardware. The kind of job, how many hadoop components are you running, which kind of HDP components are involved in the HDP cluster, behaviour of jobs, frequency of job execution etc are completely different hence the values for RAM and storage differes.

However if you want a generic guidelines for RAM/Storage then you can refer to the following docs:

1. Determining HDP Memory Configuration Settings
https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.0/bk_command-line-installation/content/determ...

2. Configuring NameNode Heap Size:
https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.0/bk_command-line-installation/content/config...

3. Hardware Planning on Slave & Master Nodes:
https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.3/bk_cluster-planning/content/hardware-for-sl...
https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.3/bk_cluster-planning/content/hardware-select...