question Re: Nifi 1.14 PutHDFS Issue in Support Questions

Nifi 1.14 PutHDFS Issue

mickt — Wed, 11 Aug 2021 10:18:44 GMT

Hi, We have recently upgraded Nifi to 1.14 and are now receiving this error when trying to write to HDFS.

"Failed to write to HDFS due to java.lang.NoClassDefFoundError: com/fasterxml/jackson/annotation/JsonIncludeProperties: java.lang.ClassNotFoundException: com.fasterxml.jackson.annotation.JsonIncludeProperties
↳ causes: java.lang.NoClassDefFoundError: com/fasterxml/jackson/annotation/JsonIncludeProperties"

I have checked and all the jackson libraries are there. If anyone has any ideas it would be very much appreciated .

Re: Nifi 1.14 PutHDFS Issue

MattWho — Fri, 13 Aug 2021 15:16:49 GMT

@mickt

I looks as though you may be hitting:
https://issues.apache.org/jira/browse/NIFI-8938

This issue was introduced via a change that was introduced as part of NiFi 1.14:
https://issues.apache.org/jira/browse/NIFI-8723

If you found this response addressed your query, please take a moment to login and click "Accept as Solution".

Thank you,

Matt

Re: Nifi 1.14 PutHDFS Issue

mickt — Fri, 13 Aug 2021 15:23:51 GMT

Hi Matt,

Thank you for your response. If I am reading the issues correctly this fix will not be deployed until version 1.15 is released?

Re: Nifi 1.14 PutHDFS Issue

MattWho — Fri, 13 Aug 2021 19:36:25 GMT

@mickt

Correct....
This recent bug fix is fixed in the current master and will be part of the next Apache NiFi 1.15 release.

Re: Nifi 1.14 PutHDFS Issue

Venkikancharla — Wed, 17 Nov 2021 14:36:50 GMT

CFM 2.1.2 / NiFI 1.13.2 has similar issue too

--------- 2021-11-16 16:33:26,306 ERROR org.apache.nifi.processors.hadoop.PutHDFS: PutHDFS[id=f498091b-ca36-3546-a105-59c8ebc57206] Failed to write to HDFS due to java.lang.NoClassDefFoundError: Could not initialize class org.apache.hadoop.util.JsonSerialization: java.lang.NoClassDefFoundError: Could not initialize class org.apache.hadoop.util.JsonSerialization ---------

Re: Nifi 1.14 PutHDFS Issue

MattWho — Mon, 22 Nov 2021 17:04:11 GMT

@Venkikancharla

You are absolutely correct that CFM 2.1.2 is also impacted by this.

While CFM 2.1.2 is based off Apache NiFi 1.13.2, it includes many bug fixes that eventually went in to Apache NiFi 1.14. One of those changes happened to be NIFI-8723.

Full list of changes made on top of Apache NiFi 1.13.2 in CFM 2.1.2 can be found here:
https://docs.cloudera.com/cfm/2.1.2/release-notes/topics/cfm-fixed-issues.html

CFM 2.1.3 will include https://issues.apache.org/jira/browse/NIFI-8938

Thank you,

Matt