Decommission disk from HDFS (Ambari Cluster)

[#1]

Hi All,

Can someone past procedure to decommission disk from Ambari cluster. It will helpful.

As we have 3 data node's and we have 3 disks configured each node and we want to remove one disk from it. 

Thanks,

Amit Mayekar

[#2 · Accepted solution]

HI @Sadique1 There is no specific option to decommission a disk from Datanode. The best option would be to decommission the Datanode followed by removing the disk and recommission it back.

https://community.cloudera.com/t5/Community-Articles/Decommission-and-Reconfigure-Data-Node-Disks/ta...

The downside of decommission and recommission is that it will need to copy all the blocks to another host for all disks, not just the one you are removing.

OR 

Considering that you don't have files with rep factor=1(fsck will tell you if any such files exist.), You could remove the disk from 1 DN and restart it, and wait for the NN to recover the under replicated blocks. Then repeat for each node.

Note : If there are files with rep factor as 1 on those Datanode disks, then you will be getting missing blocks.

Was your question answered? Please take some time to click on “Accept as Solution” below this post.
If you find a reply useful, say thanks by clicking on the thumbs up button.

[#3]

@Sadique1 Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future. Thanks