Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Hadoop cluster planning

Highlighted

Hadoop cluster planning

New Contributor

Any documents like Hadoop cluster planning mode like pro with the important ecosystems & services

3 REPLIES 3

Re: Hadoop cluster planning

Super Mentor

@Manoj Menon

We have "HDP Cluster Planning Guide" documentation link available as part of HDP documentation, hope that is what you are looking out for.

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.0/bk_cluster-planning/content/ch_hardware-rec...

Re: Hadoop cluster planning

New Contributor

Thanks jay sharma. But if there is any documents which look likes a professional hadoop cluster in a corporate environment with majority of Important services like NN,DN,zookeeper,Hbase,Hive,oozie,sqoop like .. How to assign RAM,storage...

Re: Hadoop cluster planning

Super Mentor

@Manoj Menon

Every environment runs different kind of job and has different hardware. The kind of job, how many hadoop components are you running, which kind of HDP components are involved in the HDP cluster, behaviour of jobs, frequency of job execution etc are completely different hence the values for RAM and storage differes.

However if you want a generic guidelines for RAM/Storage then you can refer to the following docs:

1. Determining HDP Memory Configuration Settings
https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.0/bk_command-line-installation/content/determ...

2. Configuring NameNode Heap Size:
https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.0/bk_command-line-installation/content/config...

3. Hardware Planning on Slave & Master Nodes:
https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.3/bk_cluster-planning/content/hardware-for-sl...
https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.3/bk_cluster-planning/content/hardware-select...