question Re: PutHive3Streaming java.lang.NoClassDefFoundError in Support Questions

PutHive3Streaming java.lang.NoClassDefFoundError

geepark — Thu, 05 May 2022 03:04:17 GMT

I had issue with puthive3streaming log below.

PutHive3Streaming[id=9209aacb-0180-1000-397f-3fe8b9f11781] Failed to properly initialize Processor. If still scheduled to run, NiFi will attempt to initialize and run the Processor again after the 'Administrative Yield Duration' has elapsed. Failure is due to java.lang.NoClassDefFoundError: org/apache/hadoop/tracing/SpanReceiverHost: java.lang.NoClassDefFoundError: org/apache/hadoop/tracing/SpanReceiverHost

Please give me advice

Re: PutHive3Streaming java.lang.NoClassDefFoundError

Althotta — Mon, 06 Jun 2022 14:47:28 GMT

@geepark Iam also facing simillar issue. How you got this resolved?.

PutHive3Streaming[id=38c56b98-0181-1000-0000-000077757de2] Failed to properly initialize Processor. If still scheduled to run, NiFi will attempt to initialize and run the Processor again after the 'Administrative Yield Duration' has elapsed. Failure is due to java.lang.NoClassDefFoundError: org/apache/hadoop/tracing/SpanReceiverHost
java.lang.NoClassDefFoundError: org/apache/hadoop/tracing/SpanReceiverHost
at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:634)
at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:619)
at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:149)

Re: PutHive3Streaming java.lang.NoClassDefFoundError

mnui — Tue, 07 Jun 2022 05:21:16 GMT

Hello,

Please verify the NiFi version you are using.

Generally speaking, this issue is tracked under NIFI-9392 and was caused by NIFI-9248

It throws multiple NoClassDefFoundError

It is fixed in NiFi 1.16.0

Regards,

Mohd Nadeem Ul Islam

Cloudera Inc.

Re: PutHive3Streaming java.lang.NoClassDefFoundError

MattWho — Tue, 07 Jun 2022 12:34:22 GMT

@Althotta @geepark

The fix for this issue is an upgrade to the Hive client used by Hive3 NiFi components.
The Hive3 Client was upgraded to Hive 3.1.3 as part of Apache NiFi 1.16.2/1.17.0
https://issues.apache.org/jira/browse/NIFI-9998

This issue is noted in the Jira https://issues.apache.org/jira/browse/NIFI-9392 (fixed in Apache NIFi 1.16.0) mentioned by @mnui, but actually fully addressed by the Hive client upgrade in above Jira. So the complete fix requires both of these fixes. CFM 2.1.4 only contains NIFI-9392.

If you found this response assisted with your query, please take a moment to login and click on "Accept as Solution" below this post.

Thank you,

Matt

Re: PutHive3Streaming java.lang.NoClassDefFoundError

VidyaSargur — Mon, 13 Jun 2022 05:52:16 GMT

Hi @geepark & @Althotta, Have the replies helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future. Thanks.

Re: PutHive3Streaming java.lang.NoClassDefFoundError

Althotta — Wed, 15 Jun 2022 08:54:54 GMT

The version 1.16.2 works. I don't see an option to accept the soln.

Re: PutHive3Streaming java.lang.NoClassDefFoundError

VidyaSargur — Wed, 15 Jun 2022 09:40:12 GMT

Thanks for the confirmation @Althotta. You should be logged in to the community to see Accept as Solution option:

I have accepted @MattWho 's and @mnui's responses on your behalf. I hope that's alright with you.