Support Questions

Find answers, ask questions, and share your expertise
Announcements
Check out our newest addition to the community, the Cloudera Data Analytics (CDA) group hub.

Nifi 1.14 PutHDFS Issue

Explorer

Hi, We have recently upgraded Nifi to 1.14 and are now receiving this error when trying to write to HDFS.

"Failed to write to HDFS due to java.lang.NoClassDefFoundError: com/fasterxml/jackson/annotation/JsonIncludeProperties: java.lang.ClassNotFoundException: com.fasterxml.jackson.annotation.JsonIncludeProperties
↳ causes: java.lang.NoClassDefFoundError: com/fasterxml/jackson/annotation/JsonIncludeProperties"

I have checked and all the jackson libraries are there. If anyone has any ideas it would be very much appreciated .

1 ACCEPTED SOLUTION

Master Guru

@mickt 

I looks as though you may be hitting:
https://issues.apache.org/jira/browse/NIFI-8938

This issue was introduced via a change that was introduced as part of NiFi 1.14:
https://issues.apache.org/jira/browse/NIFI-8723

If you found this response addressed your query, please take a moment to login and click "Accept as Solution".

Thank you,

Matt

View solution in original post

5 REPLIES 5

Master Guru

@mickt 

I looks as though you may be hitting:
https://issues.apache.org/jira/browse/NIFI-8938

This issue was introduced via a change that was introduced as part of NiFi 1.14:
https://issues.apache.org/jira/browse/NIFI-8723

If you found this response addressed your query, please take a moment to login and click "Accept as Solution".

Thank you,

Matt

Explorer

Hi Matt,

Thank you for your response. If I am reading the issues correctly this fix will not be deployed until version 1.15 is released?

Master Guru

@mickt 

 

Correct....
This recent bug fix is fixed in the current master and will be part of the next Apache NiFi 1.15 release.

 

New Contributor

CFM 2.1.2 / NiFI 1.13.2 has similar issue too

 

--------- 2021-11-16 16:33:26,306 ERROR org.apache.nifi.processors.hadoop.PutHDFS: PutHDFS[id=f498091b-ca36-3546-a105-59c8ebc57206] Failed to write to HDFS due to java.lang.NoClassDefFoundError: Could not initialize class org.apache.hadoop.util.JsonSerialization: java.lang.NoClassDefFoundError: Could not initialize class org.apache.hadoop.util.JsonSerialization ---------

Master Guru

@Venkikancharla 

 

You are absolutely correct that CFM 2.1.2 is also impacted by this.

While CFM 2.1.2 is based off Apache NiFi 1.13.2, it includes many bug fixes that eventually went in to Apache NiFi 1.14.  One of those changes happened to be NIFI-8723.

Full list of changes made on top of Apache NiFi 1.13.2 in CFM 2.1.2 can be found here:
https://docs.cloudera.com/cfm/2.1.2/release-notes/topics/cfm-fixed-issues.html

CFM 2.1.3 will include https://issues.apache.org/jira/browse/NIFI-8938

Thank you,

Matt

Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.