Skip to main content
dallanic
dallanic
Gold ⭐️
September 29, 2020
Solved

CDH 6.2.0 : Unable to remove peer from hbase shell command

Hello,

 

We are facing a problem in our production environment. The Hbase shell command "remove_peer '<peer>'" is not working.  The peer was previsously disabled ( took a very very long time to get back to the prompt ).

In our others environment, removing a peer was ok.

 

Any ideas of the problem and how to fix it?

Thanks for any help.

 

Regards

Daniel

 

dallanic
dallanicAnswer
Gold ⭐️
October 5, 2020

'abort_procedure' is deprecated and not available. Seems now it needs to use 'hbck2 --bypass' in order to abort a procedure.

We did not applied this because fortunately,

an upgrade to CDH 6.3.3 for one cluster and a yarn patch on the other one, made a HBase restart necessary. That removed the peers on both clusters.

 

View in thread

6 replies

GangWar
Platinum ⭐️⭐️
GangWar
Platinum ⭐️⭐️
September 29, 2020

@dallanic Is there any error message you are getting? 

You might want to look at various commands and try again, below doc can be useful. 

https://learnhbase.net/2013/03/02/hbase-shell-commands/

Translate
Cheers! Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.
dallanic
dallanicAuthor
Gold ⭐️
September 29, 2020

Error message is :

remove_peer '1'            

ERROR: The procedure 8290 is still running

For usage try 'help "remove_peer"'

 

Took 610.7577 seconds

 

Thanks but here is no other commands to look for removing a peer. and the command is same we used in 2 others clusters, without any problem.   Other commands like disabling the peer or getting peers informations are working fine.

Translate
GangWar
Platinum ⭐️⭐️
GangWar
Platinum ⭐️⭐️
September 29, 2020

@dallanic It is indicating that the procedure that was run to remove the entry got hung for xyz reasons.

So there might be some issue with hosts/disk/memory/table itself. 

You have to do a clean perform I would say. Try to kill hung process and then do. 

Translate
Cheers! Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.
    Terms & ConditionsAccessibility statement