question Re: PublishKafkaRecord fails all flowfiles if any of them is invalid in Support Questions

PublishKafkaRecord fails all flowfiles if any of them is invalid

apocolis — Wed, 04 Dec 2019 15:37:31 GMT

I'm using PublishKafkaRecord processor. Everything works fine, but if I stop the processor and multiple flowfiles stuck in queue when I run the processor again if any of files is invalid all files get into failed queue. Is there any batch setting or any other way to solve this?

Re: PublishKafkaRecord fails all flowfiles if any of them is invalid

MattWho — Wed, 04 Dec 2019 22:55:16 GMT

@apocolis

I recommend adding the ValidateRecord before your PublishKafkaRecord processor to filter out the invalid records from your dataflow.

Hope this helps,

Matt

Re: PublishKafkaRecord fails all flowfiles if any of them is invalid

apocolis — Thu, 05 Dec 2019 08:49:11 GMT

yes, this helped, thank you