Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Hive/Hbase Table Select query Error

Highlighted

Hive/Hbase Table Select query Error

New Contributor

when executing query select * from table_name limit 10; getting below exception

Exception in thread "main" java.lang.NoSuchMethodError: org.apache.hadoop.hbase.security.token.TokenUtil.addTokenForJob(Lorg/apache/hadoop/hbase/client/HConnection;Lorg/apache/hadoop/hbase/security/User;Lorg/apache/hadoop/mapreduce/Job;)V at org.apache.hadoop.hive.hbase.HBaseStorageHandler.addHBaseDelegationToken(HBaseStorageHandler.java:482) at org.apache.hadoop.hive.hbase.HBaseStorageHandler.configureTableJobProperties(HBaseStorageHandler.java:427) at org.apache.hadoop.hive.hbase.HBaseStorageHandler.configureInputJobProperties(HBaseStorageHandler.java:328) at org.apache.hadoop.hive.ql.plan.PlanUtils.configureJobPropertiesForStorageHandler(PlanUtils.java:817) at org.apache.hadoop.hive.ql.plan.PlanUtils.configureInputJobPropertiesForStorageHandler(PlanUtils.java:787) at org.apache.hadoop.hive.ql.optimizer.SimpleFetchOptimizer$FetchData.convertToWork(SimpleFetchOptimizer.java:385) at org.apache.hadoop.hive.ql.optimizer.SimpleFetchOptimizer$FetchData.access$000(SimpleFetchOptimizer.java:323) at org.apache.hadoop.hive.ql.optimizer.SimpleFetchOptimizer.optimize(SimpleFetchOptimizer.java:134) at org.apache.hadoop.hive.ql.optimizer.SimpleFetchOptimizer.transform(SimpleFetchOptimizer.java:105) at org.apache.hadoop.hive.ql.optimizer.Optimizer.optimize(Optimizer.java:205) at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal(SemanticAnalyzer.java:10198) at org.apache.hadoop.hive.ql.parse.CalcitePlanner.analyzeInternal(CalcitePlanner.java:211) at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:227) at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:459) at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:316) at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1189) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1237) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1126) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1116) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:216) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:168) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:379) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:739) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:684) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:624) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136)

Need Help to Solve this.

5 REPLIES 5

Re: Hive/Hbase Table Select query Error

Super Guru
@sajid mohammed

Just to confirm the process, you created an external table in Hive using HBaseStorageHandler and used required properties like hbase.table.name, hbase.mapred.output.outputtable, or hbase.column.mapping?

If this is correct and all worked fine, then you need to make sure you have correct jar files for your HBase and hive version. Is this using HDP sandbox?

Re: Hive/Hbase Table Select query Error

New Contributor

@mqureshi

Created Internal table in Hive using HBaseSerDe, HBaseStorageHandler using properties like hbase.table.name, hbase.mapred.output.outputtable, or hbase.column.mapping

And i have correct jar files for HBase and Hive version. i am using HDP 2.4.2.60-1.

the same query working on one edge node, in other edge node it is giving above error.

Re: Hive/Hbase Table Select query Error

Super Guru
@sajid mohammed

I would think that your edge node where this is failing does not have same jar files as your edge node where everything is working.

I still think this is mismatched HBase libraries.

Re: Hive/Hbase Table Select query Error

New Contributor

@mqureshi I just checked in both the nodes, all hive and hbase jars are the same, still didnt get why it is failed.

Re: Hive/Hbase Table Select query Error

Guru

@sajid mohammed

Yes I believe that might be the issue as stated by @mqureshi. Please trying adding the jar in the node in which you are working to execute the commands. "add jar <Jar path with name>;"