Created 11-29-2018 09:16 AM
Created 11-29-2018 02:20 PM
hbase(main):001:0> get 'hmcnsprod:HM_CNS_STD_IOT_INDEX','498633670' COLUMN CELL ERROR: org.apache.hadoop.hbase.NotServingRegionException: Region hmcnsprod:HM_CNS_STD_IOT_INDEX,498633670,1542558189093.e1b79d7f51636c99dabc71ecec3e706c. is not online on chmcisprbddn07.chm.intra,16020,1543476489995 at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegionByEncodedName(HRegionServer.java:3062) at org.apache.hadoop.hbase.regionserver.RSRpcServices.getRegion(RSRpcServices.java:1007) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:1984) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32381) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2141) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:112) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:187) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:167)
Region | State | RIT time (ms) |
---|---|---|
e1b79d7f51636c99dabc71ecec3e706c | hmcnsprod:HM_CNS_STD_IOT_INDEX,498633670,1542558189093.e1b79d7f51636c99dabc71ecec3e706c. state=PENDING_CLOSE, ts=Wed Nov 21 07:33:04 IST 2018 (716612s ago), server=chmcisprbddn10.chm.intra,16020,1542735119121 | |
Total number of Regions in Transition for more than 60000 milliseconds | ||
Total number of Regions in Transition |
Created 11-29-2018 02:20 PM
Region | State | RIT time (ms) |
---|---|---|
e1b79d7f51636c99dabc71ecec3e706c | hmcnsprod:HM_CNS_STD_IOT_INDEX,498633670,1542558189093.e1b79d7f51636c99dabc71ecec3e706c. state=PENDING_CLOSE, ts=Wed Nov 21 07:33:04 IST 2018 (716612s ago), server=chmcisprbddn10.chm.intra,16020,1542735119121 | |
Total number of Regions in Transition for more than 60000 milliseconds | ||
Total number of Regions in Transition |
Created 11-29-2018 03:27 PM
First, you should investigate in the log files to understand why this region became stuck in this PENDING_CLOSE state.
Then, you can close and reassign this region. HBCK should be able to do this for you, or you can use the HBase shell commands to do it by hand.