Cloudbreak for hybrid cloud (on-premise AND in-cloud)

[#1]

Hello, could Cloudbreak be used to scale out a hdp plattform into the public cloud e.g. Azure in order to react to peak ressources request e.g. for Data Science projects or for a cloud DEV Sandbox?

[#2]

@David Sight

You can use cloudbreak to have a cluster deployed on prem and then integrate with public to deploy in Azure.

http://blog.sequenceiq.com/blog/2015/02/17/opensta...

http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-...

[#3]

@David Sight you'll want to look at SequenceIQ's Periscope. It provides autoscalling via YARN. http://blog.sequenceiq.com/blog/2014/08/27/announcing-periscope/

[#4 · Accepted solution]

Hello @David Sight,

Cloudbreak is able to provision Ambari based HDP clusters on different providers(Azure,Aws,Gcp and Openstack-Juno). Cloudbreak is also capable for up/down scale clusters but just manually.

Periscope is connected to Cloudbreak and provides autoscaling functionalities based on alerts that are provided by Ambari. It could create alarms that relates Ambari's alarms and alarms could be associeated with up/down scale events. That events can up/down scale the cluster using Cloudbreak.

An overview: https://www.youtube.com/watch?v=sFSCzL7NWl4

Blog post about Periscope and its UI: http://blog.sequenceiq.com/blog/2014/12/12/cloudbreak-got-periscope/