Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Decommission disk from HDFS (Ambari Cluster)

avatar
Explorer

Hi All,

 

Can someone past procedure to decommission disk from Ambari cluster. It will helpful.

As we have 3 data node's and we have 3 disks configured each node and we want to remove one disk from it. 

 

Thanks,

Amit Mayekar

1 ACCEPTED SOLUTION

avatar
Super Collaborator

HI @Sadique1 There is no specific option to decommission a disk from Datanode. The best option would be to decommission the Datanode followed by removing the disk and recommission it back.

 

https://community.cloudera.com/t5/Community-Articles/Decommission-and-Reconfigure-Data-Node-Disks/ta...

 

The downside of decommission and recommission is that it will need to copy all the blocks to another host for all disks, not just the one you are removing.

 

OR 

 

Considering that you don't have files with rep factor=1(fsck will tell you if any such files exist.), You could remove the disk from 1 DN and restart it, and wait for the NN to recover the under replicated blocks. Then repeat for each node.

 

Note : If there are files with rep factor as 1 on those Datanode disks, then you will be getting missing blocks.

 

Was your question answered? Please take some time to click on “Accept as Solution” below this post.
If you find a reply useful, say thanks by clicking on the thumbs up button.

View solution in original post

2 REPLIES 2

avatar
Super Collaborator

HI @Sadique1 There is no specific option to decommission a disk from Datanode. The best option would be to decommission the Datanode followed by removing the disk and recommission it back.

 

https://community.cloudera.com/t5/Community-Articles/Decommission-and-Reconfigure-Data-Node-Disks/ta...

 

The downside of decommission and recommission is that it will need to copy all the blocks to another host for all disks, not just the one you are removing.

 

OR 

 

Considering that you don't have files with rep factor=1(fsck will tell you if any such files exist.), You could remove the disk from 1 DN and restart it, and wait for the NN to recover the under replicated blocks. Then repeat for each node.

 

Note : If there are files with rep factor as 1 on those Datanode disks, then you will be getting missing blocks.

 

Was your question answered? Please take some time to click on “Accept as Solution” below this post.
If you find a reply useful, say thanks by clicking on the thumbs up button.

avatar
Community Manager

@Sadique1 Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future. Thanks


Regards,

Diana Torres,
Community Moderator


Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.
Learn more about the Cloudera Community: