Created on 11-27-2019 06:11 AM - last edited on 11-27-2019 02:49 PM by ask_bill_brooks
Hi All,
We are sending some data from apache nifi to kafka topic.We are getting below error:
Failed to send all message for StandardFlowFileRecordclaim=StandardContentClaim resourceClaim=StandardResourceClaim, to Kafka; routing to failure due to org.apache.kafka.common.errors.TimeoutException: Batch Expired: org.apache.kafka.common.errors.TimeoutException: Batch Expired
org.apache.kafka.common.errors.TimeoutException: Batch Expired
Any help would be appreciated.
Created 11-27-2019 07:01 AM
When a record is added to a batch, there is a time limit for sending that batch to ensure it has been sent within a specified duration controlled by request.timeout.ms.
Default is 30 seconds, you can try increasing this value and monitor.
Can you share processor configurations to get more details?
Created 11-27-2019 09:35 PM
Processor Configurations we push the source data from Get File to Publish Kafka
GetFile:
InputDirectory: /****/**
KeepSourceFile: true
PublishKafka:
KafkaBroker: ****:9092
TopicName: ***
And Remaining will be default configuration.