Support Questions

Find answers, ask questions, and share your expertise

NiFi - PutKafka Error "failed while waiting for acks from kafka"

avatar
Rising Star

Hello,

I am learning how to use the PutKafka processor to store my live trucking data as a message into kafka. However, when I start my dataflow, I receive the following error message:

putkafka-error.png

I also included the property values that I have set for my PutKafka processor:

error-putkafka-processor.png

The Client Name value is Zookeeper.

I have the latest version of HDF 1.2.

Why am I receiving this error?

Here is my nifi template:

iot-stream-kafka-nifi.xml

Any help is highly appreciated! Thank you!

1 ACCEPTED SOLUTION

avatar
Master Mentor

Is your kafka up and topic created? Change localhost to sandbox.hortonworks.com

View solution in original post

7 REPLIES 7

avatar
Master Guru

Your port number for Kafka broker is wrong, the default on Sandbox is 6667. You are using 2181 which is the Zookeeper's port.

avatar
Rising Star

I added localhost:6667 to the property value section of the PutKafka processor. I am still getting the same error. Any other ideas on how to solve this error? Thank you again.

avatar

Switch to sanbox for host

avatar
Master Mentor

Is your kafka up and topic created? Change localhost to sandbox.hortonworks.com

avatar
Rising Star

Thank you! it worked! sandbox.hortonworks.com:6667

putkafka-success-run.png

Is the write for PutKafka suppose to be 0 bytes?

Thanks.

avatar
Master Mentor

You do not have a processor out of putKafka so it's 0. Please accept best answer.

avatar
New Contributor

hi all, i'm still getting "PutKafka Error : failed while waiting for acks from kafka" error though i see some values under "In" & "Read".

but i see attached consumer console error.

Also,i see something strange here. When i remove out Kafka from "maintenance mode" on Ambari and start the kafka broker,

it gets stopped by itself after a while.

please help me on this & find supporting attachments. @jmedel @Predrag Minovic @Artem Ervits

Note: I'm using HDP 2.6

Regards,

Akshay

45492-kafka-consumer-console-error.png

putkafka-processor-nifi-properties.png

45494-kafka-configuration-ambari.png