question Re: NiFi - PutKafka Error "failed while waiting for acks from kafka" in Support Questions

NiFi - PutKafka Error "failed while waiting for acks from kafka"

jmedel — Sat, 09 Apr 2016 04:48:30 GMT

Hello,

I am learning how to use the PutKafka processor to store my live trucking data as a message into kafka. However, when I start my dataflow, I receive the following error message:

putkafka-error.png

I also included the property values that I have set for my PutKafka processor:

error-putkafka-processor.png

The Client Name value is Zookeeper.

I have the latest version of HDF 1.2.

Why am I receiving this error?

Here is my nifi template:

iot-stream-kafka-nifi.xml

Any help is highly appreciated! Thank you!

Re: NiFi - PutKafka Error "failed while waiting for acks from kafka"

pminovic — Sat, 09 Apr 2016 08:24:42 GMT

Your port number for Kafka broker is wrong, the default on Sandbox is 6667. You are using 2181 which is the Zookeeper's port.

Re: NiFi - PutKafka Error "failed while waiting for acks from kafka"

jmedel — Sat, 09 Apr 2016 21:57:45 GMT

I added localhost:6667 to the property value section of the PutKafka processor. I am still getting the same error. Any other ideas on how to solve this error? Thank you again.

Re: NiFi - PutKafka Error "failed while waiting for acks from kafka"

aervits — Sat, 09 Apr 2016 23:35:08 GMT

Is your kafka up and topic created? Change localhost to sandbox.hortonworks.com

Re: NiFi - PutKafka Error "failed while waiting for acks from kafka"

azeltov — Sun, 10 Apr 2016 01:17:50 GMT

Switch to sanbox for host

Re: NiFi - PutKafka Error "failed while waiting for acks from kafka"

jmedel — Sun, 10 Apr 2016 03:38:22 GMT

Thank you! it worked! sandbox.hortonworks.com:6667

putkafka-success-run.png

Is the write for PutKafka suppose to be 0 bytes?

Thanks.

Re: NiFi - PutKafka Error "failed while waiting for acks from kafka"

aervits — Sun, 10 Apr 2016 04:06:54 GMT

You do not have a processor out of putKafka so it's 0. Please accept best answer.

Re: NiFi - PutKafka Error "failed while waiting for acks from kafka"

akshay_katti — Sun, 18 Aug 2019 11:33:27 GMT

hi all, i'm still getting "PutKafka Error : failed while waiting for acks from kafka" error though i see some values under "In" & "Read".

but i see attached consumer console error.

Also,i see something strange here. When i remove out Kafka from "maintenance mode" on Ambari and start the kafka broker,

it gets stopped by itself after a while.

please help me on this & find supporting attachments. @jmedel @Predrag Minovic @Artem Ervits

Note: I'm using HDP 2.6

Regards,

Akshay

putkafka-processor-nifi-properties.png