Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

NiFi - PutKafka Error "failed while waiting for acks from kafka"

Solved Go to solution
Highlighted

NiFi - PutKafka Error "failed while waiting for acks from kafka"

Contributor

Hello,

I am learning how to use the PutKafka processor to store my live trucking data as a message into kafka. However, when I start my dataflow, I receive the following error message:

putkafka-error.png

I also included the property values that I have set for my PutKafka processor:

error-putkafka-processor.png

The Client Name value is Zookeeper.

I have the latest version of HDF 1.2.

Why am I receiving this error?

Here is my nifi template:

iot-stream-kafka-nifi.xml

Any help is highly appreciated! Thank you!

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted

Re: NiFi - PutKafka Error "failed while waiting for acks from kafka"

Mentor

Is your kafka up and topic created? Change localhost to sandbox.hortonworks.com

View solution in original post

7 REPLIES 7
Highlighted

Re: NiFi - PutKafka Error "failed while waiting for acks from kafka"

Your port number for Kafka broker is wrong, the default on Sandbox is 6667. You are using 2181 which is the Zookeeper's port.

Highlighted

Re: NiFi - PutKafka Error "failed while waiting for acks from kafka"

Contributor

I added localhost:6667 to the property value section of the PutKafka processor. I am still getting the same error. Any other ideas on how to solve this error? Thank you again.

Highlighted

Re: NiFi - PutKafka Error "failed while waiting for acks from kafka"

Switch to sanbox for host

Highlighted

Re: NiFi - PutKafka Error "failed while waiting for acks from kafka"

Mentor

Is your kafka up and topic created? Change localhost to sandbox.hortonworks.com

View solution in original post

Highlighted

Re: NiFi - PutKafka Error "failed while waiting for acks from kafka"

Contributor

Thank you! it worked! sandbox.hortonworks.com:6667

putkafka-success-run.png

Is the write for PutKafka suppose to be 0 bytes?

Thanks.

Highlighted

Re: NiFi - PutKafka Error "failed while waiting for acks from kafka"

Mentor

You do not have a processor out of putKafka so it's 0. Please accept best answer.

Highlighted

Re: NiFi - PutKafka Error "failed while waiting for acks from kafka"

New Contributor

hi all, i'm still getting "PutKafka Error : failed while waiting for acks from kafka" error though i see some values under "In" & "Read".

but i see attached consumer console error.

Also,i see something strange here. When i remove out Kafka from "maintenance mode" on Ambari and start the kafka broker,

it gets stopped by itself after a while.

please help me on this & find supporting attachments. @jmedel @Predrag Minovic @Artem Ervits

Note: I'm using HDP 2.6

Regards,

Akshay

45492-kafka-consumer-console-error.png

putkafka-processor-nifi-properties.png

45494-kafka-configuration-ambari.png

Don't have an account?
Coming from Hortonworks? Activate your account here