I am new in making private clouds and hadoop ecosystem. We have three HP servers without ESX or openstack, and want to create a private cloud and then have an HDP cluster with Ambari. It would be appreciated, If somebody could explain the steps of creating a cloud and hadoop cluster by using (ESXi, openstack, cloudbreak, Ambari and ....). there are some tutorials to do this, but they are confusing to me. some of our requirements are as follows:
1- we must have at least 100TB HDFS capacity.
2- we should be able to add new nodes for increasing the capacity of HDFS and processing power.
3- we should be able to share the HDP cluster with multiple users. each user should be able to run own map/reduce job.
You have this option which covers all the 3 requirements:
Hope this helps!
Thanks for your valuable and useful suggestion. Actually, my major problem is step one.
I need to have openstack on current hp servers and also need to extend it whenever it is necessary. shall I install ESXi and then create a VM and after that install openstack? or I can install openstack on raw servers and then can create a extendable private cloud without ESXi. In fact, I am confusing with creating clusters. For example, I thought, I have to manage a cluster of servers on Vsphere, a cluster of nodes on openstack, and then a hadoop cluster on Ambari. It's still confusing for me. It would be appreciated if you could give me more information or introduce some tutorials.
thanks a million,
That first step has very little to do with Hortonworks, that's why I was not elaborating on it in detail.
As a rule of thumb, if you can go with KVM hypervisor, you should go with it.
The reasons are:
Hope this helps!