Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

hbase shell: count or scan returns org.apache.hadoop.hbase.NotServingRegionException

hbase shell: count or scan returns org.apache.hadoop.hbase.NotServingRegionException

New Contributor

We are currently using cdh5.4.2 from last few months and it happend twice that we do a scan or count on table with just 20,000 rows, it returns

org.apache.hadoop.hbase.NotServingRegionException.

We resolved this by restarting the hbase but we are wondering why we are seeing this issue at the first place. 

 

Our cluster has 21 data nodes, 21 region servers. When I do status simple command on hbase shell it returns "

Aggregate load: 339, regions: 322". Hbase version we are using is 1.0.0-cdh5.4.2

 

Please advise.

 

 

hbase(main):001:0> count '<table name>'
Current count: 1000, row: <rowkey value>                                                        

ERROR: org.apache.hadoop.hbase.NotServingRegionException: Region prod_miq_hin,59999994,1445381944470.3abe692e15b3cf26d6a11ed37dd5e715. is not online on hadoop5-data14.prod.iad1.cmates.com,60020,1444935249823
at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegionByEncodedName(HRegionServer.java:2791)
at org.apache.hadoop.hbase.regionserver.RSRpcServices.getRegion(RSRpcServices.java:887)
at org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:2103)
at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:31443)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2035)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:107)
at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130)
at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
at java.lang.Thread.run(Thread.java:745)

Here is some help for this command:
Count the number of rows in a table.  Return value is the number of rows.
This operation may take a LONG time (Run '$HADOOP_HOME/bin/hadoop jar
hbase.jar rowcount' to run a counting mapreduce job). Current count is shown
every 1000 rows by default. Count interval may be optionally specified. Scan
caching is enabled on count scans by default. Default cache size is 10 rows.
If your rows are small in size, you may want to increase this

 

1 REPLY 1

Re: hbase shell: count or scan returns org.apache.hadoop.hbase.NotServingRegionException

Master Guru
There's insufficient information to root cause this.

Try the investigation path I've mentioned on this post: http://community.cloudera.com/t5/Storage-Random-Access-HDFS/HBase-Flush/m-p/37985#M1960, to gain more insights into why.