Support Questions
Find answers, ask questions, and share your expertise

Unable to send data to Kafka from Nifi

Explorer

Hi Support Team,

I am facing the issue of timeout while sending data to Kafka from Nifi.

In Nifi I am using Publish_Kafka_1_0 transformer configured like this : 

 

dansteu_0-1633938072508.png

 

I tested previously the connection between Nifi server and Kafka server towards 9092 port and it's fine.

Unfortunatly while executing the transformer,  the following error is appearing:

 

 Failed to send StandardFlowFileRecord[uuid=b01bfeb3-3ce7-42c2-9abb-9a9f9930b87c,claim=StandardContentClaim [resourceClaim=StandardResourceClaim[id=1633677179202-1, container=default, section=1], offset=20, length=4],
offset=0,name=b01bfeb3-3ce7-42c2-9abb-9a9f9930b87c,size=4]
to Kafka: org.apache.kafka.common.errors.TimeoutException: Failed to update metadata after 20000 ms.

The kerberos connection is totally fine, so I don't know which is the connection bottleneck.

Can you kindly provide any hints ?

 

Thanks,

Daniele.

1 REPLY 1

Rising Star

Hi @dansteu 

 

The kerberos service name property has to be the service name specified for the kafka service which is usually "kafka".