Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Adding additional storage to hdp cluster running on AWS

Highlighted

Adding additional storage to hdp cluster running on AWS

Contributor

Hello there,

I have a 3 node hdp cluster running on AWS (3 t2.large instances). One of my hots (the one where Ambari is installed) has reached 100% storage utilization.

What's the standard way to add additional storage to this host without affecting the existing installation?

Thanks-

Wellington

3 REPLIES 3
Highlighted

Re: Adding additional storage to hdp cluster running on AWS

Guru

You can either resize your volumes(http://docs.aws.amazon.com/AWSEC2/latest/UserGuide/ebs-expand-volume.html) or add new volumes(http://docs.aws.amazon.com/AWSEC2/latest/UserGuide/ebs-using-volumes.html) . Resizing is more involved as you need to create a larger volume first and migrate data. If you are adding new volume, you will still see older volumes at 100% full while newer volumes at lower percentages.

VM or otherwise, general recommendation if want to add new volumes to existing nodes (or replace failed volumes) is to decommission the node and recommission it back after the volume is added. This will ensure all volumes have similar percentage of disk usage.

Highlighted

Re: Adding additional storage to hdp cluster running on AWS

@Wellington De Oliveira What else is installed / stored in this node other than Ambari Server? Please list and check if log files / Ambari metric system files are occupying most space. If so, you could add more space and move these to the new space.

Re: Adding additional storage to hdp cluster running on AWS

Don't have an account?
Coming from Hortonworks? Activate your account here