- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Nifi 1.11.1 cannot find JSONToAttributes and ConvertJSONToAvro
- Labels:
-
Apache NiFi
Created on
‎02-12-2020
12:55 PM
- last edited on
‎02-13-2020
09:46 AM
by
VidyaSargur
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Nifi 1.11.1 cannot find JSONToAttributes and ConvertJSONToAvro,
Any suggestions???
Created ‎02-17-2020 04:58 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
The ConvertJsonToAvro processor was removed from the default NiFi distribution bundle because of space limitations as of the Apache NiFi 1.10 release.
https://cwiki.apache.org/confluence/display/NIFI/Migration+Guidance
The ConvertJSONToAvro processor was part of the nifi-kite-nar
https://github.com/apache/nifi/tree/master/nifi-nar-bundles/nifi-kite-bundle
Hope this helps,
Matt
Created ‎02-12-2020 01:11 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
The specific processors you mention were never part of any distribution of Apache NiFi.
1. JSONToAttributes:
Typically when extracting json elements in to FlowFile Attrinutes you would use the EvaluateJsonPath processor. There is an "AttributesToJson" processor, is that maybe what you mean?
2. ConvertJSONToAvro
NiFi ships with a ConvertAvroToJson processor, is that perhaps what you mean? If you trying to convert from one content format to another, the preferred processor to use would be "convertRecord". In this processor's configuration you would select a Record Reader which reads the current format of the inbound FlowFile's content (JsonPathReader or JsonTreeReader in this case) and you then select a Record Writer (AvroRecordSetWriter in this case) which writes the content for the outbound FlowFile.
If the processor types you mentioned did exist for you, then they were added via a custom nar to your previous NiFi installations.
Hope this helps,
Matt
Created ‎02-13-2020 07:24 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
It seems more complicated than using JSONToAttributes or ConvertJSONToAvro processor (NiFi version lower 1.7 are supported)
Created ‎02-14-2020 09:59 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
@thuylevn
As i mentioned, NiFi has never been released with either a "JSONToAttributes' or "ConvertJSONToAvro" processor. All I can do is suggest existing processors which can hopefully accomplish what your use case requires. The other option is for you to build your own custom processor implementations and add them to your NiFi.
Hope this helps.
Thank you,
Matt
Created ‎02-14-2020 12:01 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Nifi 1.8.0 ConvertJSONToAvro
Please check again, many thanks
Created ‎02-17-2020 04:58 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
The ConvertJsonToAvro processor was removed from the default NiFi distribution bundle because of space limitations as of the Apache NiFi 1.10 release.
https://cwiki.apache.org/confluence/display/NIFI/Migration+Guidance
The ConvertJSONToAvro processor was part of the nifi-kite-nar
https://github.com/apache/nifi/tree/master/nifi-nar-bundles/nifi-kite-bundle
Hope this helps,
Matt
Created ‎02-17-2020 05:27 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
thanks @MattWho
