Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Unable to send data to Kafka from Nifi

avatar
Explorer

Hi Support Team,

I am facing the issue of timeout while sending data to Kafka from Nifi.

In Nifi I am using Publish_Kafka_1_0 transformer configured like this : 

 

dansteu_0-1633938072508.png

 

I tested previously the connection between Nifi server and Kafka server towards 9092 port and it's fine.

Unfortunatly while executing the transformer,  the following error is appearing:

 

 Failed to send StandardFlowFileRecord[uuid=b01bfeb3-3ce7-42c2-9abb-9a9f9930b87c,claim=StandardContentClaim [resourceClaim=StandardResourceClaim[id=1633677179202-1, container=default, section=1], offset=20, length=4],
offset=0,name=b01bfeb3-3ce7-42c2-9abb-9a9f9930b87c,size=4]
to Kafka: org.apache.kafka.common.errors.TimeoutException: Failed to update metadata after 20000 ms.

The kerberos connection is totally fine, so I don't know which is the connection bottleneck.

Can you kindly provide any hints ?

 

Thanks,

Daniele.

1 REPLY 1

avatar
Expert Contributor

Hi @dansteu 

 

The kerberos service name property has to be the service name specified for the kafka service which is usually "kafka".