Created on
11-27-2019
06:11 AM
- last edited on
11-27-2019
02:49 PM
by
ask_bill_brooks
Hi All,
We are sending some data from apache nifi to kafka topic.We are getting below error:
Failed to send all message for StandardFlowFileRecordclaim=StandardContentClaim resourceClaim=StandardResourceClaim, to Kafka; routing to failure due to org.apache.kafka.common.errors.TimeoutException: Batch Expired: org.apache.kafka.common.errors.TimeoutException: Batch Expired
org.apache.kafka.common.errors.TimeoutException: Batch Expired
Any help would be appreciated.
Created 11-27-2019 07:01 AM
When a record is added to a batch, there is a time limit for sending that batch to ensure it has been sent within a specified duration controlled by request.timeout.ms.
Default is 30 seconds, you can try increasing this value and monitor.
Can you share processor configurations to get more details?
Created 11-27-2019 09:35 PM
Processor Configurations we push the source data from Get File to Publish Kafka
GetFile:
InputDirectory: /****/**
KeepSourceFile: true
PublishKafka:
KafkaBroker: ****:9092
TopicName: ***
And Remaining will be default configuration.