Flume is not writing any messages to Kafka topic using KafkaSink, but works when other sinks are used.
Below is the kafkaSink configuration.
testagent2.sinks.kafkasink2.channel = memchannel2
testagent2.sinks.kafkasink2.type = org.apache.flume.sink.kafka.KafkaSink
testagent2.sinks.kafkasink2.brokerList = brokerServer:portNo
testagent2.sinks.kafkasink2.zookeeperConnect = ZookeeperServer:portNo
testagent2.sinks.kafkasink2.topic = testtopic2
testagent2.sinks.kafkasink2.batchSize = 100
testagent2.sinks.kafkasink2.requiredAcks = 1
testagent2.sinks.kafkasink2.kafka.rebalance.max.retries = 40
testagent2.sinks.kafkasink2.kafka.rebalance.backoff.ms = 5000
testagent2.sinks.kafkasink2.kafka.zookeeper.session.timeout.ms = 6000
Please note that Source and Channel configs are working without any issues when other sinks are being used.
Facing issue only with Kafka Sink. Also flume is not throwing any error in the logs and I can independently write messages to Kafka topics by other means.
Has anyone faced this issue ?