PublishKafkaRecord fails all flowfiles if any of them is invalid

[#1]

I'm using PublishKafkaRecord processor. Everything works fine, but if I stop the processor and multiple flowfiles stuck in queue when I run the processor again if any of files is invalid all files get into failed queue. Is there any batch setting or any other way to solve this?

[#2 · Accepted solution]

@apocolis 

I recommend adding the ValidateRecord before your PublishKafkaRecord processor to filter out the invalid records from your dataflow.

Hope this helps,

Matt

[#3]

yes, this helped, thank you