Created on 08-11-2021 02:44 AM - last edited on 08-11-2021 03:18 AM by VidyaSargur
Hi, We have recently upgraded Nifi to 1.14 and are now receiving this error when trying to write to HDFS.
"Failed to write to HDFS due to java.lang.NoClassDefFoundError: com/fasterxml/jackson/annotation/JsonIncludeProperties: java.lang.ClassNotFoundException: com.fasterxml.jackson.annotation.JsonIncludeProperties
↳ causes: java.lang.NoClassDefFoundError: com/fasterxml/jackson/annotation/JsonIncludeProperties"
I have checked and all the jackson libraries are there. If anyone has any ideas it would be very much appreciated .
Created 08-13-2021 08:16 AM
@mickt
I looks as though you may be hitting:
https://issues.apache.org/jira/browse/NIFI-8938
This issue was introduced via a change that was introduced as part of NiFi 1.14:
https://issues.apache.org/jira/browse/NIFI-8723
If you found this response addressed your query, please take a moment to login and click "Accept as Solution".
Thank you,
Matt
Created 08-13-2021 08:16 AM
@mickt
I looks as though you may be hitting:
https://issues.apache.org/jira/browse/NIFI-8938
This issue was introduced via a change that was introduced as part of NiFi 1.14:
https://issues.apache.org/jira/browse/NIFI-8723
If you found this response addressed your query, please take a moment to login and click "Accept as Solution".
Thank you,
Matt
Created 08-13-2021 08:23 AM
Hi Matt,
Thank you for your response. If I am reading the issues correctly this fix will not be deployed until version 1.15 is released?
Created 08-13-2021 12:36 PM
Correct....
This recent bug fix is fixed in the current master and will be part of the next Apache NiFi 1.15 release.
Created 11-17-2021 06:36 AM
CFM 2.1.2 / NiFI 1.13.2 has similar issue too
--------- 2021-11-16 16:33:26,306 ERROR org.apache.nifi.processors.hadoop.PutHDFS: PutHDFS[id=f498091b-ca36-3546-a105-59c8ebc57206] Failed to write to HDFS due to java.lang.NoClassDefFoundError: Could not initialize class org.apache.hadoop.util.JsonSerialization: java.lang.NoClassDefFoundError: Could not initialize class org.apache.hadoop.util.JsonSerialization ---------
Created 11-22-2021 09:04 AM
You are absolutely correct that CFM 2.1.2 is also impacted by this.
While CFM 2.1.2 is based off Apache NiFi 1.13.2, it includes many bug fixes that eventually went in to Apache NiFi 1.14. One of those changes happened to be NIFI-8723.
Full list of changes made on top of Apache NiFi 1.13.2 in CFM 2.1.2 can be found here:
https://docs.cloudera.com/cfm/2.1.2/release-notes/topics/cfm-fixed-issues.html
CFM 2.1.3 will include https://issues.apache.org/jira/browse/NIFI-8938
Thank you,
Matt