Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

org.apache.kafka.common.errors.TimeoutException: Batch Expired

Highlighted

org.apache.kafka.common.errors.TimeoutException: Batch Expired

New Contributor

Hi All,

  We are sending some data from apache nifi to kafka topic.We are getting below error:

 

Failed to send all message for StandardFlowFileRecordclaim=StandardContentClaim resourceClaim=StandardResourceClaim, to Kafka; routing to failure due to org.apache.kafka.common.errors.TimeoutException: Batch Expired: org.apache.kafka.common.errors.TimeoutException: Batch Expired
org.apache.kafka.common.errors.TimeoutException: Batch Expired

Any help would be appreciated.

2 REPLIES 2

Re: org.apache.kafka.common.errors.TimeoutException: Batch Expired

Contributor

@Sriram 

 

When a record is added to a batch, there is a time limit for sending that batch to ensure it has been sent within a specified duration controlled by request.timeout.ms. 

 

Default is 30 seconds, you can try increasing this value and monitor.

Can you share processor configurations to get more details?

 

Re: org.apache.kafka.common.errors.TimeoutException: Batch Expired

New Contributor

Processor Configurations we push the source data from Get File to Publish Kafka

GetFile:

InputDirectory: /****/**

KeepSourceFile: true

 

PublishKafka:

KafkaBroker: ****:9092

TopicName: ***

 And Remaining will be default configuration.

 

Don't have an account?
Coming from Hortonworks? Activate your account here