Created 12-08-2020 12:34 AM
Using GetFile I’m collecting files that include JSON records. Each record includes a parameter (let's name it Sensor) that have the Value A or B.
Based on that value I wish to route each record to a different output port – which module I should use? Do I need to split the records or I can stay at the level of the file?
An example of a record that can be found in the file
{"EventTime":"2020-12-07 04:49:00",
"Sensor":"A",
"Keywords":-9223372036854775808,
"EventType":"INFO",
"SeverityValue":2,
"Severity":"INFO",}
Created 12-08-2020 08:41 AM
QueryRecord processor
Created 12-09-2020 01:25 AM
Created 12-09-2020 08:37 AM
@stephane_davy, I'm happy to see that @TimothySpann's solution resolved your issue. Can you please mark the response as the solution? This will make it easier for others to find the answer in the future.
Regards,
Vidya Sargur,Created 12-09-2020 10:16 AM
Look at everything that has *Record in the name for anything like CSV, JSON, Parquet, AVRO, Logs.
https://www.datainmotion.dev/2020/07/ingesting-all-weather-data-with-apache.html