I want to convert the entire file to avro only if all records matches the record schema

rbalakrishnantc — Mon, 14 Nov 2016 22:03:53 GMT

I am using the 'ConvertCSVToAVRO' processor. My requirement is, I should further process the file only if all the records matches the schema. But, now, the processor generates flowfile as soon as the 'record' matches the schema. How can i continue with the flow only with 'entire file' matches the schema

Re: I want to convert the entire file to avro only if all records matches the record schema

bbende — Mon, 14 Nov 2016 22:58:06 GMT

ConvertCsvToAvro attempts to convert each record... if at least one record was converted successfully then it transfers that flow file to "success", if any records could not be converted then it also transfers a flow file to "incompatible" which has all of the original CSV in the content and a summary of the incompatible records in an attribute called "errors".

I think you need to implement a custom version of this processor that only transfers the flow file to success when the error count equals 0.

question Re: I want to convert the entire file to avro only if all records matches the record schema in Archives of Support Questions (Read Only)

I want to convert the entire file to avro only if all records matches the record schema

Re: I want to convert the entire file to avro only if all records matches the record schema