- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Issue with Hive HQL insert query - KryoException - Encounter encorrect class id
- Labels:
-
Apache Hive
-
Apache Tez
-
Apache YARN
-
HDFS
-
MapReduce
Created 11-07-2024 10:39 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi
I have hadoop cluster with version 3.4.0, hive version 3.1.3 and tez 0.9.2
When i try to insert data i am facing issue:
insert into client_orc_update (client_name) values("hello");
Caused by: org.apache.hive.com.esotericsoftware.kryo.KryoException: Encountered unregistered class ID: 95
Serialization trace:
conf (org.apache.hadoop.hive.ql.exec.TableScanOperator)
aliasToWork (org.apache.hadoop.hive.ql.plan.MapWork)
another error i am getting on insert command with overwrite when transfering data from one table to another.
Caused by: java.util.concurrent.ExecutionException: java.lang.NoSuchMethodError: org.apache.hadoop.fs.FileStatus.compareTo(Lorg/apache/hadoop/fs/FileStatus;)I at java.util.concurrent.FutureTask.report(FutureTask.java:122) at java.util.concurrent.FutureTask.get(FutureTask.java:192) at org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.generateSplitsInfo(OrcInputFormat.java:1790) ... 17 more Caused by: java.lang.NoSuchMethodError: org.apache.hadoop.fs.FileStatus.compareTo(Lorg/apache/hadoop/fs/FileStatus;)I
When run the above queries on MR it works.
but if change the execution engine to tez, it throws error;
Can anyone help here? Thanks
Created 11-10-2024 11:19 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Generally, a NoSuchMethodError occurs when there is a mismatch in the classpath. To resolve this issue, please verify the classpaths of both HS2 and Hadoop, to ensure that there are no incorrect versions of Hadoop libraries present.
If you are not able to identify any mismatched jar, please add the -verboseJVM argument to both HS2 and hive.tez.java.opts. This will help validate the classes loaded as part of the query and provide additional information.
Created 11-08-2024 11:21 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
@rsurti Welcome to the Cloudera Community!
To help you get the best possible solution, I have tagged our Hadoop experts @sandeepV2 @Asok who may be able to assist you further.
Please keep us updated on your post, and we hope you find a satisfactory solution to your query.
Regards,
Diana Torres,Community Moderator
Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.
Learn more about the Cloudera Community:
Created 11-10-2024 11:19 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Generally, a NoSuchMethodError occurs when there is a mismatch in the classpath. To resolve this issue, please verify the classpaths of both HS2 and Hadoop, to ensure that there are no incorrect versions of Hadoop libraries present.
If you are not able to identify any mismatched jar, please add the -verboseJVM argument to both HS2 and hive.tez.java.opts. This will help validate the classes loaded as part of the query and provide additional information.
Created 11-10-2024 11:22 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Thanks yes it was version mismatch issue upgrading hive - 4.0 and tez 0.10.3 works forme
