Thanks @DennisJaheruddi for updating question here. Really sorry that I couldn't able to update this thread, was caught up in some other ingestion errors. Thanks @stevenmatison for your input. Currently I am using ExecuteScript processor to handle double quote. You did mention that - "csv reader if configured properly will ignore the escape characters... " . Could you please provide idea/example about which CSVReader property we need to configure to ignore escape characters ( I'm not able to relate any CSVReader controller service property which would ignore escape characters)
... View more
Hi Team, I am trying to validate CSV to Avro using ValidateRecord processor. The Record Reader property of ValidateRecord processor is set to CSVReader controller service. Quote Character is set as double quotes (") for this CSVReader controller service. When I try to validate flowfiles, few of the flowfiles are redirecting to failure relationship because of double quotes present in field value. Sample csv row from flowfile content : "ICUA","01/22/2019","08:48:18",394846,"HAVE YOU REMOVED THE KEY?","YES---select "Accept Response" and continue with the remove","","","1" I thought to use ReplaceText but this would tamper the actual value of the field. It would be really helpful if somebody could provide the approach to deal with this situation. Really appreciate your support. Thanks, Vikram.
... View more