Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

NiFi - PutKafka Error "failed while waiting for acks from kafka"

avatar
Rising Star

Hello,

I am learning how to use the PutKafka processor to store my live trucking data as a message into kafka. However, when I start my dataflow, I receive the following error message:

putkafka-error.png

I also included the property values that I have set for my PutKafka processor:

error-putkafka-processor.png

The Client Name value is Zookeeper.

I have the latest version of HDF 1.2.

Why am I receiving this error?

Here is my nifi template:

iot-stream-kafka-nifi.xml

Any help is highly appreciated! Thank you!

1 ACCEPTED SOLUTION

avatar
Master Mentor
hide-solution

This problem has been solved!

Want to get a detailed solution you have to login/registered on the community

Register/Login
7 REPLIES 7

avatar
Master Guru

Your port number for Kafka broker is wrong, the default on Sandbox is 6667. You are using 2181 which is the Zookeeper's port.

avatar
Rising Star

I added localhost:6667 to the property value section of the PutKafka processor. I am still getting the same error. Any other ideas on how to solve this error? Thank you again.

avatar

Switch to sanbox for host

avatar
Master Mentor
hide-solution

This problem has been solved!

Want to get a detailed solution you have to login/registered on the community

Register/Login

avatar
Rising Star

Thank you! it worked! sandbox.hortonworks.com:6667

putkafka-success-run.png

Is the write for PutKafka suppose to be 0 bytes?

Thanks.

avatar
Master Mentor

You do not have a processor out of putKafka so it's 0. Please accept best answer.

avatar
New Contributor

hi all, i'm still getting "PutKafka Error : failed while waiting for acks from kafka" error though i see some values under "In" & "Read".

but i see attached consumer console error.

Also,i see something strange here. When i remove out Kafka from "maintenance mode" on Ambari and start the kafka broker,

it gets stopped by itself after a while.

please help me on this & find supporting attachments. @jmedel @Predrag Minovic @Artem Ervits

Note: I'm using HDP 2.6

Regards,

Akshay

45492-kafka-consumer-console-error.png

putkafka-processor-nifi-properties.png

45494-kafka-configuration-ambari.png