Cloudera Community

Announcements
Celebrating as our community reaches 100,000 members! Thank you!
vikram_shinde
user rank
New Contributor

Re: Nifi, CSV to Avro ValidateRecord - routing fl...

by New Contributor in Support Questions
‎12-25-2019 09:32 PM
‎12-25-2019 09:32 PM
Thanks @DennisJaheruddi for updating question here. Really sorry that  I couldn't able to update this thread, was caught up in some other ingestion errors.   Thanks @stevenmatison for your input. Currently I am using ExecuteScript processor to handle double quote. You did mention that - "csv reader if configured properly will ignore the escape characters... " . Could you please provide idea/example about which CSVReader property we need to configure to ignore  escape characters ( I'm  not able to relate any CSVReader controller service property which would ignore escape characters)   ... View more

Nifi, CSV to Avro ValidateRecord - routing flowfi...

by New Contributor in Support Questions
‎12-19-2019 05:47 AM
‎12-19-2019 05:47 AM
Hi Team,    I am trying to validate CSV to Avro using ValidateRecord processor.  The Record Reader property of ValidateRecord processor is set to CSVReader controller service. Quote Character is set as double quotes (") for this CSVReader controller service.   When I try to validate flowfiles, few of the flowfiles are redirecting to failure relationship because of double quotes present in field value.    Sample csv row from flowfile content :   "ICUA","01/22/2019","08:48:18",394846,"HAVE YOU REMOVED THE KEY?","YES---select "Accept Response" and continue with the remove","","","1"   I thought to use ReplaceText but this would tamper the actual value of the field.    It would be really helpful if somebody could provide the approach to deal with this situation.    Really appreciate your support.    Thanks, Vikram.   ... View more
Contact Me
Online
Offline
Last Visited
‎02-13-2020 10:14 AM
Community Statistics
Member Since ‎07-22-2019 05:01 AM
Last Visited ‎02-13-2020 10:14 AM
Posts 3