Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Scaling and Auto-scaling of HDP on AWS and Azure Cloud

avatar
Expert Contributor

My understanding along with questions as below,

AWS-HDCloud

Manual scaling using Ambari or AWS UI possible.

Auto Scaling

1. Is it possible to auto-scale in this option (while creating the cluster can i set auto-scaling group)?

1.1. In that case, how is the data re-balanced? i.e. if a new node is added, then compute may not gain data locality.

--------------------------------------------------------------------------------------------------------------------------------------------------------------

AWS-HDP on IaaS

Manual scaling using Ambari is possible.

Auto Scaling-Without CloudBreak

2. Is it possible to auto-scale in this option (while creating the cluster can i set auto-scaling group)?

2.1. In that case, how is the data re-balanced? i.e. if a new node is added, then compute may not gain data locality.

Auto Scaling-WithCloudBreak

Auto-scaling may be possible, but question 2.1 applies here as well.

--------------------------------------------------------------------------------------------------------------------------------------------------------------

Azure-HdInsights

Manual scaling using Ambari or Azure UI possible.

Auto Scaling

3. Is it possible to auto-scale in this option (while creating the cluster can i set auto-scaling group)?

3.1. In that case, how is the data re-balanced? i.e. if a new node is added, then compute may not gain data locality.

--------------------------------------------------------------------------------------------------------------------------------------------------------------

Azure-HDP in MarketPlace

Manual scaling using Ambari or Azure UI possible.

Auto Scaling

4. Is it possible to auto-scale in this option (while creating the cluster can i set auto-scaling group)?

4.1. In that case, how is the data re-balanced? i.e. if a new node is added, then compute may not gain data locality.

--------------------------------------------------------------------------------------------------------------------------------------------------------------

Azure-HDP on IaaS

Same questions as AWS-HDP on IaaS

1 ACCEPTED SOLUTION

avatar
hide-solution

This problem has been solved!

Want to get a detailed solution you have to login/registered on the community

Register/Login
2 REPLIES 2

avatar
hide-solution

This problem has been solved!

Want to get a detailed solution you have to login/registered on the community

Register/Login

avatar

@learninghuman If this answer helps, please accept it. Otherwise, I'd be happy to answer any remaining questions you have.

Thanks! _Tom