HDP on AWS

[#1]

I have a requirement where i will have a 5 node permanaent cluster. ( 2 master nodes and 3 slave nodes). Hbase will be running on it. so this portion of the cluster is permanent. I have a MR load which is not frequent (once in a week). for that i need to provision additional 20 slave nodes. Once the job is complete, i need to tear off these nodes. The data on HDFS on the slave nodes can be deleted , once the job finishes. What could be the best possible way to bring the slave nodes quickly and make it as a part of the cluster.

Though cloudbreak is available, our organization has no experience on it and dont want to take the risk.

AWs is our cloud service provider and what is the best way to fulfill our requirement. Will the concept of AMI's in AWS be of any help in this case

[#2]

@ARUN Please check if Ambari Blueprint be of help here.

[#3 · Accepted solution]

@ARUN

Cloudbreak is the tool that will allow you to automate this using Ambari Blueprint.