Skip to main content
thuylevn
Silver ⭐️⭐️⭐️
February 12, 2020
Solved

Nifi 1.11.1 cannot find JSONToAttributes and ConvertJSONToAvro

Nifi 1.11.1 cannot find JSONToAttributes and ConvertJSONToAvro,

Any suggestions???

MattWho
MattWhoAnswer
Titanium ⭐️⭐️⭐️
February 18, 2020

@thuylevn 

 

The ConvertJsonToAvro processor was removed from the default NiFi distribution bundle because of space limitations as of the Apache NiFi 1.10 release.

 

https://cwiki.apache.org/confluence/display/NIFI/Migration+Guidance

The ConvertJSONToAvro processor was part of the nifi-kite-nar

https://github.com/apache/nifi/tree/master/nifi-nar-bundles/nifi-kite-bundle

 

Hope this helps,

Matt

6 replies

MattWho
Titanium ⭐️⭐️⭐️
Titanium ⭐️⭐️⭐️
February 12, 2020

@thuylevn 

 

The specific processors you mention were never part of any distribution of Apache NiFi.

 

1. JSONToAttributes:
Typically when extracting json elements in to FlowFile Attrinutes you would use the EvaluateJsonPath processor.  There is an "AttributesToJson" processor, is that maybe what you mean?

2. ConvertJSONToAvro
NiFi ships with a ConvertAvroToJson processor, is that perhaps what you mean? If you trying to convert from one content format to another, the preferred processor to use would be "convertRecord".  In this processor's configuration you would select a Record Reader which reads the current format of the inbound FlowFile's content (JsonPathReader or JsonTreeReader in this case) and you then select a Record Writer (AvroRecordSetWriter in this case) which writes the content for the outbound FlowFile.

 

If the processor types you mentioned did exist for you, then they were added via a custom nar to your previous NiFi installations.

 

Hope this helps,

Matt

Translate
thuylevn
thuylevnAuthor
Silver ⭐️⭐️⭐️
February 13, 2020

It seems more complicated than using JSONToAttributes or ConvertJSONToAvro processor (NiFi version lower 1.7 are supported)

Translate
MattWho
Titanium ⭐️⭐️⭐️
Titanium ⭐️⭐️⭐️
February 14, 2020

@thuylevn 

As i mentioned, NiFi has never been released with either a "JSONToAttributes' or "ConvertJSONToAvro" processor.  All I can do is suggest existing processors which can hopefully accomplish what your use case requires.  The other option is for you to build your own custom processor implementations and add them to your NiFi.

 

Hope this helps.  

Thank you,

Matt

Translate