- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Nifi 1.14 PutHDFS Issue
- Labels:
-
Apache NiFi
-
HDFS
Created on
‎08-11-2021
02:44 AM
- last edited on
‎08-11-2021
03:18 AM
by
VidyaSargur
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi, We have recently upgraded Nifi to 1.14 and are now receiving this error when trying to write to HDFS.
"Failed to write to HDFS due to java.lang.NoClassDefFoundError: com/fasterxml/jackson/annotation/JsonIncludeProperties: java.lang.ClassNotFoundException: com.fasterxml.jackson.annotation.JsonIncludeProperties
↳ causes: java.lang.NoClassDefFoundError: com/fasterxml/jackson/annotation/JsonIncludeProperties"
I have checked and all the jackson libraries are there. If anyone has any ideas it would be very much appreciated .
Created ‎08-13-2021 08:16 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
@mickt
I looks as though you may be hitting:
https://issues.apache.org/jira/browse/NIFI-8938
This issue was introduced via a change that was introduced as part of NiFi 1.14:
https://issues.apache.org/jira/browse/NIFI-8723
If you found this response addressed your query, please take a moment to login and click "Accept as Solution".
Thank you,
Matt
Created ‎08-13-2021 08:16 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
@mickt
I looks as though you may be hitting:
https://issues.apache.org/jira/browse/NIFI-8938
This issue was introduced via a change that was introduced as part of NiFi 1.14:
https://issues.apache.org/jira/browse/NIFI-8723
If you found this response addressed your query, please take a moment to login and click "Accept as Solution".
Thank you,
Matt
Created ‎08-13-2021 08:23 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi Matt,
Thank you for your response. If I am reading the issues correctly this fix will not be deployed until version 1.15 is released?
Created ‎08-13-2021 12:36 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Correct....
This recent bug fix is fixed in the current master and will be part of the next Apache NiFi 1.15 release.
Created ‎11-17-2021 06:36 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
CFM 2.1.2 / NiFI 1.13.2 has similar issue too
--------- 2021-11-16 16:33:26,306 ERROR org.apache.nifi.processors.hadoop.PutHDFS: PutHDFS[id=f498091b-ca36-3546-a105-59c8ebc57206] Failed to write to HDFS due to java.lang.NoClassDefFoundError: Could not initialize class org.apache.hadoop.util.JsonSerialization: java.lang.NoClassDefFoundError: Could not initialize class org.apache.hadoop.util.JsonSerialization ---------
Created ‎11-22-2021 09:04 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
You are absolutely correct that CFM 2.1.2 is also impacted by this.
While CFM 2.1.2 is based off Apache NiFi 1.13.2, it includes many bug fixes that eventually went in to Apache NiFi 1.14. One of those changes happened to be NIFI-8723.
Full list of changes made on top of Apache NiFi 1.13.2 in CFM 2.1.2 can be found here:
https://docs.cloudera.com/cfm/2.1.2/release-notes/topics/cfm-fixed-issues.html
CFM 2.1.3 will include https://issues.apache.org/jira/browse/NIFI-8938
Thank you,
Matt
