question Re: How to setup a cluster count: in Archives of Support Questions (Read Only)

How to setup a cluster count:

ssanku — Tue, 26 Apr 2016 12:47:42 GMT

Hi,

Can you please help me understand how would we know how to setup a cluster depending on the size of the data and in HA mode and without HA mode. Please excuse if this is a simple question.

Re: How to setup a cluster count:

drussell — Tue, 26 Apr 2016 13:09:56 GMT

Hi @sujitha sanku that's a big question to answer in a short response, but probably the best resource to point you at is the high level sizing calculator which we have on-line here: http://hortonworks.com/blog/how-to-size-your-hadoop-cluster/

There's also a whitepaper linked from there too.

Finally, do check out the cluster planning guide documentation for HDP as well:

http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.4.0/bk_cluster-planning-guide/content/ch_hardware-recommendations_chapter.html

Hope that helps!

Re: How to setup a cluster count:

drussell — Tue, 26 Apr 2016 13:11:53 GMT

One more thing to add is that HA mode or non HA mode only adds one or two nodes when you're getting started, and isn't dependant on how much data you have. Very large clusters may well have more master nodes to further distribute the services of course.

Re: How to setup a cluster count:

ssanku — Wed, 27 Apr 2016 06:30:49 GMT

Hi Drussell,

Thank you for pointing me to the resources.That really helps.

Thanks,

Sujitha