Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Hardware recommendation for non-production

Highlighted

Hardware recommendation for non-production

Explorer

Hi

In our development site we have a concept of prod-like environment.

These are large clusters (10-15 nodes) where we run various benchmark tests for our products.

Until now we used physical servers - 2 U rack-mount servers with multiple internal disks configured as JBOD.

now we have increased the requirements of the number of environments - we need to have 5-6 such environment for the latest product and we need to have available environments for existing customer with older version of our products.

so, I was thinking of moving from physical servers to use ESX hypervisor and use VMs.

this will enable me to use less resource and be more flexibile in the configuration.

We got recommendation to use HPE Synergy, which can mix blades and Disks in the same chassis.

Can anyone share if they handle similar issues and how they resolved them?

Thanks
Doron

PS we're using both CDH and HDP (existing customers have different versions), main components are Kafka, HBase, Hive and SPARK, and additional SW like Cassandra. Elasticsearch and more.

1 REPLY 1
Highlighted

Re: Hardware recommendation for non-production

New Contributor

It is fairly uncommon to virtualize environments for HDP / CDH.  However what you are proposing is possible.  We are actually working with the USAF and they are propsing a similar configuration to test different environments. 

 

Also in my view you can save significant dollars looking at other hardware platforms than HPE Synergy. I'm definitely more than a bit biased since my companies develops and manufacturers server and cluster platforms for Cloudera platforms. 

Don't have an account?
Coming from Hortonworks? Activate your account here