Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Kafka 0.9 new-producer on kerberized HDP 2.4

avatar
New Contributor

I am trying to run kafka-console-producer.sh script on a kerberized HDP 2.4 sandbox with Kafka 0.9. I have created a topic and provided user permissions to the topic.

Below is the command I am using to start the producer:

./kafka-console-producer.sh --topic test-topic --broker-list sandbox.hortonworks.com:6667 --security-protocol PLAINTEXTSASL --new-producer

Below is the error I get when I try to produce something:

ERROR Error when sending message to topic test-topic with key: null, value: 8 bytes with error: Failed to update metadata after 60000 ms. (org.apache.kafka.clients.producer.internals.ErrorLoggingCallback)

It works fine when I don't use the new-producer, but I need to use the new producer API.

1 ACCEPTED SOLUTION

avatar
Rising Star

For new producer api, try increasing the metadata.fetch.timeout.ms in producer config and also socket.timeout.ms

View solution in original post

4 REPLIES 4

avatar
Rising Star

For new producer api, try increasing the metadata.fetch.timeout.ms in producer config and also socket.timeout.ms

avatar
New Contributor

I changed the above properties to 600000 ms, still the issue exists.

avatar
Rising Star

What is your config/server.properties and config/producer.properties? Anything in zookeeper logs?

avatar

We had same issue and increasing time out values worked.