Hi, I am planning to setup a private cloud using openstack and use cloudbreak to create HDP(2.4) clusters. So can you guys tell me what would be the ideal hardware configuration, openstack version and other details?. In my use case I want to create hdp clusters with different services and node sizes and also test autoscaling feature.
There is no one config - fits all setup. Like on any public providers where you have pre-set configs, in OpenStack you can create your own instance configs. Since Cloudbreak supports heterogenous clusters I suggest to create different Nova instances which fits best your different HDP components or workload (e.g. high memory for Spark, multi-core for compute heavy workloads, etc). Re OpenStack version - for now we support stock Kilo and Juno. I suggest to check the docs: http://sequenceiq.com/cloudbreak-docs/latest/openstack/
If you don't have an OpenStack cluster yet you might consider checking these Ansible scripts: https://github.com/sequenceiq/openstack-ansible