Skip to main content
geepark
geepark
Bronze ⭐️⭐️⭐️
May 5, 2022
Solved

PutHive3Streaming java.lang.NoClassDefFoundError

I had issue with puthive3streaming log below.

PutHive3Streaming[id=9209aacb-0180-1000-397f-3fe8b9f11781] Failed to properly initialize Processor. If still scheduled to run, NiFi will attempt to initialize and run the Processor again after the 'Administrative Yield Duration' has elapsed. Failure is due to java.lang.NoClassDefFoundError: org/apache/hadoop/tracing/SpanReceiverHost: java.lang.NoClassDefFoundError: org/apache/hadoop/tracing/SpanReceiverHost

Please give me advice 

mnui
mnuiAnswer
Gold ⭐️
June 7, 2022

Hello,

 

Please verify the NiFi version you are using.

Generally speaking, this issue is tracked under NIFI-9392 and was caused by NIFI-9248   

It throws multiple NoClassDefFoundError

 

It is fixed in NiFi 1.16.0

 

Regards, 

Mohd Nadeem Ul Islam 

Cloudera Inc. 

 

View in thread

6 replies

Althotta
Althotta
Silver ⭐️⭐️⭐️
June 6, 2022

@geepark Iam also facing simillar issue. How you got this resolved?.

PutHive3Streaming[id=38c56b98-0181-1000-0000-000077757de2] Failed to properly initialize Processor. If still scheduled to run, NiFi will attempt to initialize and run the Processor again after the 'Administrative Yield Duration' has elapsed. Failure is due to java.lang.NoClassDefFoundError: org/apache/hadoop/tracing/SpanReceiverHost
java.lang.NoClassDefFoundError: org/apache/hadoop/tracing/SpanReceiverHost
at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:634)
at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:619)
at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:149)

Translate
MattWho
Titanium ⭐️⭐️⭐️
MattWho
Titanium ⭐️⭐️⭐️
June 7, 2022

@Althotta @geepark 

The fix for this issue is an upgrade to the Hive client used by Hive3 NiFi components.
The Hive3 Client was upgraded to Hive 3.1.3 as part of Apache NiFi 1.16.2/1.17.0
https://issues.apache.org/jira/browse/NIFI-9998

This issue is noted in the Jira https://issues.apache.org/jira/browse/NIFI-9392 (fixed in Apache NIFi 1.16.0) mentioned by @mnui, but actually fully addressed by the Hive client upgrade in above Jira.  So the complete fix requires both of these fixes.  CFM 2.1.4 only contains NIFI-9392.

If you found this response assisted with your query, please take a moment to login and click on "Accept as Solution" below this post.

Thank you,

Matt



Translate
mnui
Gold ⭐️
mnuiAnswer
Gold ⭐️
June 7, 2022

Hello,

 

Please verify the NiFi version you are using.

Generally speaking, this issue is tracked under NIFI-9392 and was caused by NIFI-9248   

It throws multiple NoClassDefFoundError

 

It is fixed in NiFi 1.16.0

 

Regards, 

Mohd Nadeem Ul Islam 

Cloudera Inc. 

 

Translate
    VidyaSargur
    Community Manager
    VidyaSargur
    Community Manager
    June 13, 2022

    Hi @geepark & @Althotta, Have the replies helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future. Thanks. 

    Translate
    Regards, Vidya Sargur, Community Manager Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.
    Althotta
    Althotta
    Silver ⭐️⭐️⭐️
    June 15, 2022

    The version 1.16.2 works. I don't see an option to accept the soln. 

    Translate
    VidyaSargur
    Community Manager
    VidyaSargur
    Community Manager
    June 15, 2022

    Thanks for the confirmation @Althotta. You should be logged in to the community to see Accept as Solution option: 

    VidyaSargur_0-1655285846000.png

    I have accepted @MattWho 's and @mnui's responses on your behalf. I hope that's alright with you.

     

     

    Translate
    Regards, Vidya Sargur, Community Manager Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.
    Terms & ConditionsAccessibility statement