Hive error while inserting data in to HBASE

sai_hadoop — Fri, 16 Sep 2022 08:49:47 GMT

Using HBASE: 0.94.10
Hive: 0.11.0
Hadoop:1.2.1

    Trying to insert data into hbase table through hive.:

    Create table query:
    CREATE TABLE hbase_testing(id int, name string, password string) STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
     WITH SERDEPROPERTIES ("hbase.columns.mapping" = ":key,cf1:val") TBLPROPERTIES ("hbase.table.name" = "hbase_testing");

    Insert Query:

    INSERT OVERWRITE TABLE hbase_test2 SELECT * FROM user WHERE key=1;

    ERROR:
    ===========
    Diagnostic Messages for this Task:
    java.lang.RuntimeException: Error in configuring object
       at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
       at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
       at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
       at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:426)
       at org.apache.hadoop.mapred.MapTask.run(MapTask.java:366)
       at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
       at java.security.AccessController.doPrivileged(Native Method)
       at javax.security.auth.Subject.doAs(Subject.java:415)
       at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1190)
       at org.apache.hadoop.mapred.Child.main(Child.java:249)
    Caused by: java.lang.reflect.InvocationTargetException
       at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
       at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
       at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
       at java.lang.reflect.Method.invoke(Method.java:601)
       at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
       ... 9 more
    Caused by: java.lang.RuntimeException: Error in configuring object
       at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
       at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
       at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
       at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
       ... 14 more
    Caused by: java.lang.reflect.InvocationTargetException
       at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
       at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
       at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
       at java.lang.reflect.Method.invoke(Method.java:601)
       at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
       ... 17 more
    Caused by: java.lang.RuntimeException: Map operator initialization failed
       at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:121)
       ... 22 more
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.NullPointerException
       at org.apache.hadoop.hive.ql.exec.FileSinkOperator.initializeOp(FileSinkOperator.java:385)
       at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:375)
       at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:451)
       at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:407)
       at org.apache.hadoop.hive.ql.exec.SelectOperator.initializeOp(SelectOperator.java:62)
       at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:375)
       at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:451)
       at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:407)
       at org.apache.hadoop.hive.ql.exec.TableScanOperator.initializeOp(TableScanOperator.java:186)
       at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:375)
       at org.apache.hadoop.hive.ql.exec.MapOperator.initializeOp(MapOperator.java:543)
       at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:375)
       at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:100)
       ... 22 more
    Caused by: java.lang.NullPointerException
       at org.apache.hadoop.hive.ql.exec.FileSinkOperator.initializeOp(FileSinkOperator.java:322)
       ... 34

Re: Hive error while inserting data in to HBASE

Radius — Mon, 28 Oct 2013 09:12:25 GMT

Above problem has been solved by adding hbase.jar in /usr/lib/hadoop/lib & add some jar files like hive-hbase-handler.jar, hbase.jar, guava.jar, zookeeper.jar, hive-contrib.jar in auxpth in hive-site.xml as given below:

<name>hive.aux.jars.path</name>
<description>Specify paths to jars for hbase integration - must update each CDH release!</description>
<value>file:///usr/lib/hive/lib/hive-hbase-handler-0.10.0-cdh4.3.0.jar,file:///usr/lib/hive/lib/hbase.jar,file:///usr/lib/hive/lib/guava-11.0.2.jar,file:///usr/lib/hive/lib/zookeeper.jar,file:///usr/lib/hive/lib/hive-contrib-0.10.0-cdh4.3.0.jar</value>
</property>

Thanks

Surbhi

question Re: Hive error while inserting data in to HBASE in Archives of Support Questions (Read Only)

Hive error while inserting data in to HBASE

Re: Hive error while inserting data in to HBASE