Skip to main content
Sadique1
Gold ⭐️
December 28, 2022
Solved

Decommission disk from HDFS (Ambari Cluster)

Hi All,

 

Can someone past procedure to decommission disk from Ambari cluster. It will helpful.

As we have 3 data node's and we have 3 disks configured each node and we want to remove one disk from it. 

 

Thanks,

Amit Mayekar

rki_
rki_Answer
Gold ⭐️
December 28, 2022

HI @Sadique1 There is no specific option to decommission a disk from Datanode. The best option would be to decommission the Datanode followed by removing the disk and recommission it back.

 

https://community.cloudera.com/t5/Community-Articles/Decommission-and-Reconfigure-Data-Node-Disks/ta-p/248262

 

The downside of decommission and recommission is that it will need to copy all the blocks to another host for all disks, not just the one you are removing.

 

OR 

 

Considering that you don't have files with rep factor=1(fsck will tell you if any such files exist.), You could remove the disk from 1 DN and restart it, and wait for the NN to recover the under replicated blocks. Then repeat for each node.

 

Note : If there are files with rep factor as 1 on those Datanode disks, then you will be getting missing blocks.

 

Was your question answered? Please take some time to click on “Accept as Solution” below this post.
If you find a reply useful, say thanks by clicking on the thumbs up button.

2 replies

rki_
Gold ⭐️
rki_Answer
Gold ⭐️
December 28, 2022

HI @Sadique1 There is no specific option to decommission a disk from Datanode. The best option would be to decommission the Datanode followed by removing the disk and recommission it back.

 

https://community.cloudera.com/t5/Community-Articles/Decommission-and-Reconfigure-Data-Node-Disks/ta-p/248262

 

The downside of decommission and recommission is that it will need to copy all the blocks to another host for all disks, not just the one you are removing.

 

OR 

 

Considering that you don't have files with rep factor=1(fsck will tell you if any such files exist.), You could remove the disk from 1 DN and restart it, and wait for the NN to recover the under replicated blocks. Then repeat for each node.

 

Note : If there are files with rep factor as 1 on those Datanode disks, then you will be getting missing blocks.

 

Was your question answered? Please take some time to click on “Accept as Solution” below this post.
If you find a reply useful, say thanks by clicking on the thumbs up button.

Translate
DianaTorres
Community Manager
Community Manager
January 10, 2023

@Sadique1 Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future. Thanks

Translate
Regards, Diana Torres, Senior Community Moderator