Support Questions
Find answers, ask questions, and share your expertise
Announcements
Check out our newest addition to the community, the Cloudera Innovation Accelerator group hub.

Unable to send data to Kafka from Nifi

Explorer

Hi Support Team,

I am facing the issue of timeout while sending data to Kafka from Nifi.

In Nifi I am using Publish_Kafka_1_0 transformer configured like this : 

 

dansteu_0-1633938072508.png

 

I tested previously the connection between Nifi server and Kafka server towards 9092 port and it's fine.

Unfortunatly while executing the transformer,  the following error is appearing:

 

 Failed to send StandardFlowFileRecord[uuid=b01bfeb3-3ce7-42c2-9abb-9a9f9930b87c,claim=StandardContentClaim [resourceClaim=StandardResourceClaim[id=1633677179202-1, container=default, section=1], offset=20, length=4],
offset=0,name=b01bfeb3-3ce7-42c2-9abb-9a9f9930b87c,size=4]
to Kafka: org.apache.kafka.common.errors.TimeoutException: Failed to update metadata after 20000 ms.

The kerberos connection is totally fine, so I don't know which is the connection bottleneck.

Can you kindly provide any hints ?

 

Thanks,

Daniele.

1 REPLY 1

Expert Contributor

Hi @dansteu 

 

The kerberos service name property has to be the service name specified for the kafka service which is usually "kafka".