Reply
Explorer
Posts: 62
Registered: ‎08-07-2017

Getting hbase exceptions when doing hbase load

Hi All,

 

We are getting below exceptions for hbase load.

 

As(Subject.java:415)

        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1912)

        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)

2017-09-11 01:27:18,399 WARN [main] org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation: Encountered problems when prefetch hbase:meta table:

org.apache.hadoop.hbase.TableNotFoundException: Cannot find row in hbase:meta for table: asset, row=asset,367abb38-dc1c-43d8-bcfa-5ca9cd560f7a,99999999999999

        at org.apache.hadoop.hbase.client.MetaScanner.metaScan(MetaScanner.java:146)

        at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.prefetchRegionCache(HConnectionManager.java:1140)

        at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegionInMeta(HConnectionManager.java:1204)

        at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:1092)

        at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:1049)

        at org.apache.hadoop.hbase.client.AsyncProcess.findDestLocation(AsyncProcess.java:365)

        at org.apache.hadoop.hbase.client.AsyncProcess.submit(AsyncProcess.java:310)

        at org.apache.hadoop.hbase.client.HTable.backgroundFlushCommits(HTable.java:965)

        at org.apache.hadoop.hbase.client.HTable.flushCommits(HTable.java:1281)

        at org.apache.hadoop.hbase.mapreduce.MultiTableOutputFormat$MultiTableRecordWriter.close(MultiTableOutputFormat.java:115)

        at org.apache.hadoop.mapred.MapTask$NewDirectOutputCollector.close(MapTask.java:670)

        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:793)

        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)

        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)

        at java.security.AccessController.doPrivileged(Native Method)

        at javax.security.auth.Subject.doAs(Subject.java:415)

        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1912)

        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)

2017-09-11 01:27:18,405 WARN [main] org.apache.hadoop.security.UserGroupInformation: PriviledgedActionException as:ipdevusr (auth:SIMPLE) cause:org.apache.hadoop.hbase.client.RetriesExhaustedWithDetailsException: Failed 14 actions: asset: 14 times,

2017-09-11 01:27:18,405 WARN [main] org.apache.hadoop.mapred.YarnChild: Exception running child : org.apache.hadoop.hbase.client.RetriesExhaustedWithDetailsException: Failed 14 actions: asset: 14 times,

        at org.apache.hadoop.hbase.client.AsyncProcess$BatchErrors.makeException(AsyncProcess.java:192)

        at org.apache.hadoop.hbase.client.AsyncProcess$BatchErrors.access$500(AsyncProcess.java:176)

        at org.apache.hadoop.hbase.client.AsyncProcess.getErrors(AsyncProcess.java:913)

        at org.apache.hadoop.hbase.client.HTable.backgroundFlushCommits(HTable.java:985)

        at org.apache.hadoop.hbase.client.HTable.flushCommits(HTable.java:1281)

        at org.apache.hadoop.hbase.mapreduce.MultiTableOutputFormat$MultiTableRecordWriter.close(MultiTableOutputFormat.java:115)

        at org.apache.hadoop.mapred.MapTask$NewDirectOutputCollector.close(MapTask.java:670)

        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:793)

        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)

        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)

        at java.security.AccessController.doPrivileged(Native Method)

        at javax.security.auth.Subject.doAs(Subject.java:415)

        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1912)

        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)

 

2017-09-11 01:27:18,411 INFO [main] org.apache.hadoop.mapred.Task: Runnning cleanup for the task

2017-09-11 01:27:18,515 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Stopping MapTask metrics system...

2017-09-11 01:27:18,515 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: MapTask metrics system stopped.

2017-09-11 01:27:18,516 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: MapTask metrics system shutdown complete.

 

I checked list command and scan command through hbase shell , and both gave desirable output and no error.

 

Please suggest.

 

Thanks,

Priya

Highlighted
Explorer
Posts: 62
Registered: ‎08-07-2017

Re: Getting hbase exceptions when doing hbase load

I forgot to add namespace along with tablename. now it's working fine.

Thanks,
Priya
Announcements