@Madhu V You can add custom Metadata. I had written a CLI that uses the Atlas API to do this. The best code sample is with QuickStart.java which is part of the Atlas Code base. Take a look at that. There is also support for REST Calls ... View more

@Ram D Did you take a look at this. https://slider.incubator.apache.org/docs/manpage.html Commands for testing These operations are here primarily for testing. kill-container <name> --id container-id Kill a YARN container belong to the application. This is useful primarily for testing the resilience to failures. Container IDs can be determined from the application instance status JSON document. ... View more

@ARUNKUMAR RAMASAMY In hortonworks platform we have Cloudbreak. It is open source http://sequenceiq.com/cloudbreak-docs/latest/ You can use it to launch Clusters on Amazon, Azure Google Cloud. It needs a host to install the Cloudbreak software and then it will spin up the nodes for you. One thing you have ti understand that if you have data in HDFS, it is not easy to bring down nodes. HDFS will kick off HDFS rebalance which will take time. An elastic cluster will work well when you use a detached storage like Blob storage behind it. Note scaling up is not an issue, it is scaling down that you will experience some rough time :). ... View more