org.apache.kafka.common.errors.TimeoutException: Batch Expired

[#1]

Hi All,

  We are sending some data from apache nifi to kafka topic.We are getting below error:

Failed to send all message for StandardFlowFileRecordclaim=StandardContentClaim resourceClaim=StandardResourceClaim, to Kafka; routing to failure due to org.apache.kafka.common.errors.TimeoutException: Batch Expired: org.apache.kafka.common.errors.TimeoutException: Batch Expired
org.apache.kafka.common.errors.TimeoutException: Batch Expired

Any help would be appreciated.

[#2]

@Sriram 

When a record is added to a batch, there is a time limit for sending that batch to ensure it has been sent within a specified duration controlled by request.timeout.ms. 

Default is 30 seconds, you can try increasing this value and monitor.

Can you share processor configurations to get more details?

[#3]

Processor Configurations we push the source data from Get File to Publish Kafka

GetFile:

InputDirectory: /****/**

KeepSourceFile: true

PublishKafka:

KafkaBroker: ****:9092

TopicName: ***

 And Remaining will be default configuration.