Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Planning HDP cluster on power servers

Highlighted

Planning HDP cluster on power servers

New Contributor

I need the minimum H/W to build HDP cluster on Power servers Power8

so I know the "planning-cluster" document

" https://docs.hortonworks.com/HDPDocuments/HDP3/HDP-3.1.0/cluster-planning/cluster-planning.pdf "

but my question :

Is there any document provide the HDP Cluster sizing on Power architecture specifically??

there is a huge difference between x64 and the Power processor.

3 REPLIES 3

Re: Planning HDP cluster on power servers

Mentor

@Mahmoud Shash

Have a look at these 2 links IBM Redbooks are my first choice when it comes to technical architecture, the link below has all you need to know about implementing Hadoop on power architecture

IBM redbooks

HDP 3 on Power 9 - Ref Arch - IBM

https://www.ibm.com/downloads/cas/PVYEOA0E

https://hortonworks.com/solution-brief/hdp-on-ibm-power-systems/

HTH

Re: Planning HDP cluster on power servers

New Contributor

thanks, @Geoffrey Shelton Okot

for your prompt response,

the point is that I'm looking for documentation illustrates the minimum pre-requisite for Power servers Spec, not a reference Specs

Re: Planning HDP cluster on power servers

Mentor

@Mahmoud Shash

If you are looking for minimum config then just scale down the specs in those documents. I know IBM's config is always an overkill for performance and these could be perfect for production environments. If you talk of cluster planning I imagine you will have the same for DEV, UAT and PROD but scaled out Having said that the documents I attached specifically to give you sizing for Edge, Master and Slave nodes in respect to [Cores, Memory, Disk, Network] that's basically what you need to plan your cluster deployment and Apache Hadoop, Spark and data science workloads unless you are looking for some specific setup.

HTH

Don't have an account?
Coming from Hortonworks? Activate your account here