Cloudera Community
agriff
user rank
Frequent Visitor

Re: Nifi PublishKafka silent failures

by Frequent Visitor in Support Questions
‎06-10-2025 02:33 AM
‎06-10-2025 02:33 AM
I'm publishing to Kafka 2.5 and running Nifi 2.4. There doesn't seem to be a choice in Nifi 2 for Kafka libraries - one size fits all? Anyway, not exactly sure what I did but suddenly I started getting errors reported to bulletin board and was able to diagnose and fix the underlying issue. It was a schema issue - missing fields without default value. I still don't get bulletins for successfully produced logs to Kafka, but from what you're saying that's just a limitation of the 3rd party libraries used? ... View more

Nifi PublishKafka silent failures

by Frequent Visitor in Support Questions
‎06-05-2025 07:16 AM
‎06-05-2025 07:16 AM
I'm trying to construct a process group that produces to a Kafka topic. It's failing as all records are routed to the failure queue, but I get no errors from the PublishKafka processor to help me diagnose the problem. Digging into the PublishKafka process it seems that it doesn't produce any output whether on success or failure, despite having bulletin level set to DEBUG. If I substitute for a PutFile processor set to DEBUG then I get bulletins for each written file. So this looks like an issue specific to PublishKafka? ... View more
Labels:
Contact Me
Online
Offline
Last Visited
‎09-15-2025 09:11 AM
Community Statistics
Member Since ‎06-05-2025 06:48 AM
Last Visited ‎09-15-2025 09:11 AM
Posts 2