Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

hbase region getting stopped

Highlighted

hbase region getting stopped

New Contributor

Hmaster:-

2017-10-19 04:19:45,616 ERROR [PriorityRpcServer.handler=8,queue=0,port=16000] master.MasterRpcServices: Region server cbc-slv1.vodafone.flytxt.com,16020,1505158335244 reported a fatal error:

2017-10-19 04:19:46,571 ERROR [PriorityRpcServer.handler=19,queue=1,port=16000] master.MasterRpcServices: Region server cbc-slv4.vodafone.flytxt.com,16020,1505158341501 reported a fatal error:

HRegion :-

cbc-slv1

4:18:19,755 INFO [B.defaultRpcServer.handler=9,queue=3,port=16020] shortcircuit.ShortCircuitCache: ShortCircuitCache(0x30040ff9): could not load 1218930687_BP-1248144674-10.88.8.135-1467124509456 due to InvalidToken exception.

org.apache.hadoop.security.token.SecretManager$InvalidToken: access control error while attempting to set up short-circuit access to /hbase/data/default/SUBSCRIBER/6285afac5334bd9afd3527c7f43f9d30/T/050298e63ea648dd93093e04343a8e75Block token with block_token_identifier (expiryDate=1508362433325, keyId=1595020424, userId=hbase, blockPoolId=BP-1248144674-10.88.8.135-1467124509456, blockId=1218930687, access modes=[READ]) is expired.

at org.apache.hadoop.hdfs.BlockReaderFactory.requestFileDescriptors(BlockReaderFactory.java:591)at org.apache.hadoop.hdfs.BlockReaderFactory.requestFileDescriptors(BlockReaderFactory.java:591)

at org.apache.hadoop.hdfs.BlockReaderFactory.createShortCircuitReplicaInfo(BlockReaderFactory.java:490)at org.apache.hadoop.hdfs.BlockReaderFactory.createShortCircuitReplicaInfo(BlockReaderFactory.java:490)

at org.apache.hadoop.hdfs.shortcircuit.ShortCircuitCache.create(ShortCircuitCache.java:782)

at org.apache.hadoop.hdfs.shortcircuit.ShortCircuitCache.fetchOrCreate(ShortCircuitCache.java:716)


2017-10-19 04:19:43,803 INFO [Thread-7] regionserver.ShutdownHook: Shutdown hook starting; hbase.shutdown.hook=true; fsShutdownHook=org.apache.hadoop.fs.FileSystem$Cache$ClientFinalizer@420249a9

2017-10-19 04:19:43,803 INFO [Thread-7] regionserver.HRegionServer: STOPPED: Shutdown hook

2017-10-19 04:19:43,803 INFO [regionserver/cbc-slv1.vodafone.flytxt.com/10.88.8.137:16020] regionserver.SplitLogWorker: Sending interrupt to stop the worker thread

2017-10-19 04:19:43,806 INFO [regionserver/cbc-slv1.vodafone.flytxt.com/10.88.8.137:16020] regionserver.HRegionServer: Stopping infoServer

2017-10-19 04:19:43,814 INFO [SplitLogWorker-cbc-slv1:16020] regionserver.SplitLogWorker: SplitLogWorker interrupted. Exiting.

2017-10-19 04:19:43,814 INFO [SplitLogWorker-cbc-slv1:16020] regionserver.SplitLogWorker: SplitLogWorker cbc-slv1.vodafone.flytxt.com,16020,1505158335244 exiting

2017-10-19 04:19:43,819 INFO [regionserver/cbc-slv1.vodafone.flytxt.com/10.88.8.137:16020] mortbay.log: Stopped SelectChannelConnector@0.0.0.0:16030

2017-10-19 04:19:43,920 INFO [regionserver/cbc-slv1.vodafone.flytxt.com/10.88.8.137:16020] regionserver.HeapMemoryManager: Stoping HeapMemoryTuner chore.

2017-10-19 04:19:43,920 INFO [regionserver/cbc-slv1.vodafone.flytxt.com/10.88.8.137:16020] snapshot.RegionServerSnapshotManager: Stopping RegionServerSnapshotManager graceful