Support Questions

Find answers, ask questions, and share your expertise

Nifi - split Avro file based on a filed or condition on filed

avatar
Rising Star

Is there any Nifi processor available to split avro file into multiple avro files based on condition ,means avro is array of json files and schema , ex : col1 ,col2, col3 .. are fields of my JSON/avro schema. my requirement is to divide avro based on col1 values . if col1 is having a, b, c values , i would like to route a set of json files to another processor as one avro file, b set to another processor ...etc ).

1 ACCEPTED SOLUTION

avatar
Master Guru

As of NiFi 1.0.0 (HDF 2.0.0), there is no way to directly evaluate Avro fields, instead you might use ConvertAvroToJSON and apply the same approach as described in your other question.

If/When NIFI-962 is implemented, then such operations might be available directly on the Avro file.

View solution in original post

1 REPLY 1

avatar
Master Guru

As of NiFi 1.0.0 (HDF 2.0.0), there is no way to directly evaluate Avro fields, instead you might use ConvertAvroToJSON and apply the same approach as described in your other question.

If/When NIFI-962 is implemented, then such operations might be available directly on the Avro file.