question Re: Issue with Hive HQL insert query - KryoException - Encounter encorrect class id in Support Questions

Issue with Hive HQL insert query - KryoException - Encounter encorrect class id

rsurti — Fri, 08 Nov 2024 06:39:32 GMT

I have hadoop cluster with version 3.4.0, hive version 3.1.3 and tez 0.9.2

When i try to insert data i am facing issue:

insert into client_orc_update (client_name) values("hello");

Caused by: org.apache.hive.com.esotericsoftware.kryo.KryoException: Encountered unregistered class ID: 95
Serialization trace:
conf (org.apache.hadoop.hive.ql.exec.TableScanOperator)
aliasToWork (org.apache.hadoop.hive.ql.plan.MapWork)

another error i am getting on insert command with overwrite when transfering data from one table to another.

Caused by: java.util.concurrent.ExecutionException: java.lang.NoSuchMethodError: org.apache.hadoop.fs.FileStatus.compareTo(Lorg/apache/hadoop/fs/FileStatus;)I
        at java.util.concurrent.FutureTask.report(FutureTask.java:122)
        at java.util.concurrent.FutureTask.get(FutureTask.java:192)
        at org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.generateSplitsInfo(OrcInputFormat.java:1790)
        ... 17 more
Caused by: java.lang.NoSuchMethodError: org.apache.hadoop.fs.FileStatus.compareTo(Lorg/apache/hadoop/fs/FileStatus;)I

When run the above queries on MR it works.

but if change the execution engine to tez, it throws error;

Can anyone help here? Thanks

Re: Issue with Hive HQL insert query - KryoException - Encounter encorrect class id

DianaTorres — Fri, 08 Nov 2024 19:21:55 GMT

@rsurti Welcome to the Cloudera Community!

To help you get the best possible solution, I have tagged our Hadoop experts @sandeepV2 @Asok who may be able to assist you further.

Please keep us updated on your post, and we hope you find a satisfactory solution to your query.

Re: Issue with Hive HQL insert query - KryoException - Encounter encorrect class id

ggangadharan — Mon, 11 Nov 2024 07:19:51 GMT

Generally, a NoSuchMethodError occurs when there is a mismatch in the classpath. To resolve this issue, please verify the classpaths of both HS2 and Hadoop, to ensure that there are no incorrect versions of Hadoop libraries present.

If you are not able to identify any mismatched jar, please add the -verboseJVM argument to both HS2 and hive.tez.java.opts. This will help validate the classes loaded as part of the query and provide additional information.

Re: Issue with Hive HQL insert query - KryoException - Encounter encorrect class id

rsurti — Mon, 11 Nov 2024 07:22:10 GMT

Thanks yes it was version mismatch issue upgrading hive - 4.0 and tez 0.10.3 works forme