- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Nifi - split Avro file based on a filed or condition on filed
- Labels:
-
Apache NiFi
Created ‎10-13-2016 01:51 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Is there any Nifi processor available to split avro file into multiple avro files based on condition ,means avro is array of json files and schema , ex : col1 ,col2, col3 .. are fields of my JSON/avro schema. my requirement is to divide avro based on col1 values . if col1 is having a, b, c values , i would like to route a set of json files to another processor as one avro file, b set to another processor ...etc ).
Created ‎10-13-2016 01:58 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
As of NiFi 1.0.0 (HDF 2.0.0), there is no way to directly evaluate Avro fields, instead you might use ConvertAvroToJSON and apply the same approach as described in your other question.
If/When NIFI-962 is implemented, then such operations might be available directly on the Avro file.
Created ‎10-13-2016 01:58 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
As of NiFi 1.0.0 (HDF 2.0.0), there is no way to directly evaluate Avro fields, instead you might use ConvertAvroToJSON and apply the same approach as described in your other question.
If/When NIFI-962 is implemented, then such operations might be available directly on the Avro file.
