Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Nifi 1.11.1 cannot find JSONToAttributes and ConvertJSONToAvro

Solved Go to solution

Nifi 1.11.1 cannot find JSONToAttributes and ConvertJSONToAvro

Explorer

Nifi 1.11.1 cannot find JSONToAttributes and ConvertJSONToAvro,

Any suggestions???

1 ACCEPTED SOLUTION

Accepted Solutions

Re: Nifi 1.11.1 cannot find JSONToAttributes and ConvertJSONToAvro

Master Guru

@thuylevn 

 

The ConvertJsonToAvro processor was removed from the default NiFi distribution bundle because of space limitations as of the Apache NiFi 1.10 release.

 

https://cwiki.apache.org/confluence/display/NIFI/Migration+Guidance

The ConvertJSONToAvro processor was part of the nifi-kite-nar

https://github.com/apache/nifi/tree/master/nifi-nar-bundles/nifi-kite-bundle

 

Hope this helps,

Matt

6 REPLIES 6
Highlighted

Re: Nifi 1.11.1 cannot find JSONToAttributes and ConvertJSONToAvro

Master Guru

@thuylevn 

 

The specific processors you mention were never part of any distribution of Apache NiFi.

 

1. JSONToAttributes:
Typically when extracting json elements in to FlowFile Attrinutes you would use the EvaluateJsonPath processor.  There is an "AttributesToJson" processor, is that maybe what you mean?

2. ConvertJSONToAvro
NiFi ships with a ConvertAvroToJson processor, is that perhaps what you mean? If you trying to convert from one content format to another, the preferred processor to use would be "convertRecord".  In this processor's configuration you would select a Record Reader which reads the current format of the inbound FlowFile's content (JsonPathReader or JsonTreeReader in this case) and you then select a Record Writer (AvroRecordSetWriter in this case) which writes the content for the outbound FlowFile.

 

If the processor types you mentioned did exist for you, then they were added via a custom nar to your previous NiFi installations.

 

Hope this helps,

Matt

Re: Nifi 1.11.1 cannot find JSONToAttributes and ConvertJSONToAvro

Explorer

It seems more complicated than using JSONToAttributes or ConvertJSONToAvro processor (NiFi version lower 1.7 are supported)

Re: Nifi 1.11.1 cannot find JSONToAttributes and ConvertJSONToAvro

Master Guru

@thuylevn 

As i mentioned, NiFi has never been released with either a "JSONToAttributes' or "ConvertJSONToAvro" processor.  All I can do is suggest existing processors which can hopefully accomplish what your use case requires.  The other option is for you to build your own custom processor implementations and add them to your NiFi.

 

Hope this helps.  

Thank you,

Matt

Re: Nifi 1.11.1 cannot find JSONToAttributes and ConvertJSONToAvro

Explorer

Nifi 1.8.0 ConvertJSONToAvro

ConvertJSONToAvro.PNG

 

Please check again, many thanks

Re: Nifi 1.11.1 cannot find JSONToAttributes and ConvertJSONToAvro

Master Guru

@thuylevn 

 

The ConvertJsonToAvro processor was removed from the default NiFi distribution bundle because of space limitations as of the Apache NiFi 1.10 release.

 

https://cwiki.apache.org/confluence/display/NIFI/Migration+Guidance

The ConvertJSONToAvro processor was part of the nifi-kite-nar

https://github.com/apache/nifi/tree/master/nifi-nar-bundles/nifi-kite-bundle

 

Hope this helps,

Matt

Re: Nifi 1.11.1 cannot find JSONToAttributes and ConvertJSONToAvro

Explorer

thanks @MattWho

Don't have an account?
Coming from Hortonworks? Activate your account here