Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Is is possible to dynamically add or delete nodes in hadoop cluster?if its there please help me out?

Highlighted

Is is possible to dynamically add or delete nodes in hadoop cluster?if its there please help me out?

New Contributor
 
3 REPLIES 3
Highlighted

Re: Is is possible to dynamically add or delete nodes in hadoop cluster?if its there please help me out?

@Barada Nayak

I would like to understand you POC (what exactly you are looking for ?).

You can have some script for blueprint to add node dynamically to the cluster. Pls refer -

https://docs.hortonworks.com/HDPDocuments/Ambari-2.4.1.0/bk_ambari-user-guide/content/ch_managing_ho...

https://community.hortonworks.com/articles/1333/dynamically-adding-hosts-to-an-existing-cluster-wi.h...

I have earlier worked on EMR. You can check for AWS EMR which can be used for autoscaling hadoop cluster.

Highlighted

Re: Is is possible to dynamically add or delete nodes in hadoop cluster?if its there please help me out?

@Barada Nayak

Refer to the below link to see how you can add/delete nodes in ambari managed HDP cluster.

This link is for Ambari-2.4.0.1, if you are using older version of ambari, the same can be found under docs.hortonworks.com.

https://docs.hortonworks.com/HDPDocuments/Ambari-2.4.1.0/bk_ambari-user-guide/content/ch_managing_ho...

Re: Is is possible to dynamically add or delete nodes in hadoop cluster?if its there please help me out?

@Barada Nayak

The response is Cloudbreak: http://hortonworks.com/apache/cloudbreak/

It can meet the requirement in either public clouds or private clouds built with OpenStack. This type of elasticity you are looking for is the driving requirement for Cloudbreak. Additionally, you could consider Hortonworks DataCloud which is built in top of AWS using Cloudbreak.

++

If any of the response in the thread helped, please vote and accept best answer.

Don't have an account?
Coming from Hortonworks? Activate your account here