Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]

Support Questions

Find answers, ask questions, and share your expertise
Announcements
Share your experience with Cloudera on G2 and get a $25 Amazon Gift card.
Hi, I'm CLEO! Something exciting is coming to the Community. Stay Tuned!

Nifi 1.11.1 cannot find JSONToAttributes and ConvertJSONToAvro

avatar
Rising Star

Nifi 1.11.1 cannot find JSONToAttributes and ConvertJSONToAvro,

Any suggestions???

1 ACCEPTED SOLUTION

avatar
Master Mentor

@thuylevn 

 

The ConvertJsonToAvro processor was removed from the default NiFi distribution bundle because of space limitations as of the Apache NiFi 1.10 release.

 

https://cwiki.apache.org/confluence/display/NIFI/Migration+Guidance

The ConvertJSONToAvro processor was part of the nifi-kite-nar

https://github.com/apache/nifi/tree/master/nifi-nar-bundles/nifi-kite-bundle

 

Hope this helps,

Matt

View solution in original post

6 REPLIES 6

avatar
Master Mentor

@thuylevn 

 

The specific processors you mention were never part of any distribution of Apache NiFi.

 

1. JSONToAttributes:
Typically when extracting json elements in to FlowFile Attrinutes you would use the EvaluateJsonPath processor.  There is an "AttributesToJson" processor, is that maybe what you mean?

2. ConvertJSONToAvro
NiFi ships with a ConvertAvroToJson processor, is that perhaps what you mean? If you trying to convert from one content format to another, the preferred processor to use would be "convertRecord".  In this processor's configuration you would select a Record Reader which reads the current format of the inbound FlowFile's content (JsonPathReader or JsonTreeReader in this case) and you then select a Record Writer (AvroRecordSetWriter in this case) which writes the content for the outbound FlowFile.

 

If the processor types you mentioned did exist for you, then they were added via a custom nar to your previous NiFi installations.

 

Hope this helps,

Matt

avatar
Rising Star

It seems more complicated than using JSONToAttributes or ConvertJSONToAvro processor (NiFi version lower 1.7 are supported)

avatar
Master Mentor

@thuylevn 

As i mentioned, NiFi has never been released with either a "JSONToAttributes' or "ConvertJSONToAvro" processor.  All I can do is suggest existing processors which can hopefully accomplish what your use case requires.  The other option is for you to build your own custom processor implementations and add them to your NiFi.

 

Hope this helps.  

Thank you,

Matt

avatar
Rising Star

Nifi 1.8.0 ConvertJSONToAvro

ConvertJSONToAvro.PNG

 

Please check again, many thanks

avatar
Master Mentor

@thuylevn 

 

The ConvertJsonToAvro processor was removed from the default NiFi distribution bundle because of space limitations as of the Apache NiFi 1.10 release.

 

https://cwiki.apache.org/confluence/display/NIFI/Migration+Guidance

The ConvertJSONToAvro processor was part of the nifi-kite-nar

https://github.com/apache/nifi/tree/master/nifi-nar-bundles/nifi-kite-bundle

 

Hope this helps,

Matt

avatar
Rising Star

thanks @MattWho