What are Different Measures and Best Practices for Capacity Planning my Hadoop cluster?

[#1]

What are different measures and best practices for Capacity Planning my Hadoop cluster? We are planning to have large amounts of data coming in, so we would like to maintain best practices in capacity planning and hardware to grow the cluster. Please advice on this.

Thanks,

Suri

[#2]

@Suri Nuthalapati

There is no summary to this guide, it is thorough and precise. Give this a try.

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.0/bk_cluster-planning-guide/bk_cluster-planni...

[#3]

Thank you, srai.

[#4]

Be very wary of any hardware planning guide that's more than 3 or 4 months old. Hardware moves fast! 40 core machines with 768GB memory and 6,8, or 10 TB drives are here today. Many Hadoop clusters waste CPU & network by not buying large enough machines.