question Re: How much Disk requirement is needed to deploy a HDP cluster? in Archives of Support Questions (Read Only)

How much Disk requirement is needed to deploy a HDP cluster?

pfctic2 — Thu, 15 Sep 2016 14:08:13 GMT

Hi everyone!

I am a student of the University of the Basque Country and I am trying to deploy a small cluster with HDP. I was surfing across the installation guide of Hortonworks, but I didn't find the answer I want. My question is:

How much memory and disk space is needed to deploy a cluster of 2 initial nodes with Ambari and HDP? I have 25GB of disk and 4GB of memory per node? Is it enough?

Thank you so much!

Re: How much Disk requirement is needed to deploy a HDP cluster?

nitinshk77 — Thu, 15 Sep 2016 14:39:03 GMT

Hi,

Please follow this document for requirements of HDP,

https://docs.hortonworks.com/HDPDocuments/Ambari-2.2.1.0/bk_Installing_HDP_AMB/content/_memory_requirements.html

Re: How much Disk requirement is needed to deploy a HDP cluster?

pfctic2 — Thu, 15 Sep 2016 14:49:54 GMT

I saw that page, but there are only the minimum requirements for the installation of Ambari. Inthis case, if I follow the minimum specifications of installing Ambari, would I get the needed requirements for installing HDP correctly? Thank you for your quick answer!

Re: How much Disk requirement is needed to deploy a HDP cluster?

nitinshk77 — Thu, 15 Sep 2016 14:57:52 GMT

add more space to Slave node and add memory to Master node. What services you want to install on hdp?

Re: How much Disk requirement is needed to deploy a HDP cluster?

pfctic2 — Thu, 15 Sep 2016 15:04:29 GMT

The components I want to install are the next ones: AMBARI, ZEPPELIN, SQOOP, RANGER, YARN, HDFS, SPARK (Sparksql, Python, R). Thank you for your answer!

Re: How much Disk requirement is needed to deploy a HDP cluster?

nitinshk77 — Thu, 15 Sep 2016 15:08:07 GMT

Install all master components on master machine which has more than 10GB of memory and 50GB of Disk space. After that On slave node add more disk space depending on the usage requirement and 4GB memory will be sufficient for that.

Re: How much Disk requirement is needed to deploy a HDP cluster?

nitinshk77 — Thu, 15 Sep 2016 15:08:46 GMT

Install slave component on slave node as well.

Re: How much Disk requirement is needed to deploy a HDP cluster?

pfctic2 — Thu, 15 Sep 2016 15:23:38 GMT

Thank you so much for your help! I will try it that way!

Re: How much Disk requirement is needed to deploy a HDP cluster?

nitinshk77 — Thu, 15 Sep 2016 16:48:18 GMT

If this solved your question please accept the answer, it will closed this issue then.