Support Questions

Find answers, ask questions, and share your expertise
Announcements
Check out our newest addition to the community, the Cloudera Data Analytics (CDA) group hub.

NiFi - PutKafka Error "failed while waiting for acks from kafka"

Contributor

Hello,

I am learning how to use the PutKafka processor to store my live trucking data as a message into kafka. However, when I start my dataflow, I receive the following error message:

putkafka-error.png

I also included the property values that I have set for my PutKafka processor:

error-putkafka-processor.png

The Client Name value is Zookeeper.

I have the latest version of HDF 1.2.

Why am I receiving this error?

Here is my nifi template:

iot-stream-kafka-nifi.xml

Any help is highly appreciated! Thank you!

1 ACCEPTED SOLUTION

Mentor

Is your kafka up and topic created? Change localhost to sandbox.hortonworks.com

View solution in original post

7 REPLIES 7

Your port number for Kafka broker is wrong, the default on Sandbox is 6667. You are using 2181 which is the Zookeeper's port.

Contributor

I added localhost:6667 to the property value section of the PutKafka processor. I am still getting the same error. Any other ideas on how to solve this error? Thank you again.

Switch to sanbox for host

Mentor

Is your kafka up and topic created? Change localhost to sandbox.hortonworks.com

Contributor

Thank you! it worked! sandbox.hortonworks.com:6667

putkafka-success-run.png

Is the write for PutKafka suppose to be 0 bytes?

Thanks.

Mentor

You do not have a processor out of putKafka so it's 0. Please accept best answer.

New Contributor

hi all, i'm still getting "PutKafka Error : failed while waiting for acks from kafka" error though i see some values under "In" & "Read".

but i see attached consumer console error.

Also,i see something strange here. When i remove out Kafka from "maintenance mode" on Ambari and start the kafka broker,

it gets stopped by itself after a while.

please help me on this & find supporting attachments. @jmedel @Predrag Minovic @Artem Ervits

Note: I'm using HDP 2.6

Regards,

Akshay

45492-kafka-consumer-console-error.png

putkafka-processor-nifi-properties.png

45494-kafka-configuration-ambari.png

Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.