question Re: Kafka MirrorMaker - not working in Support Questions

Kafka MirrorMaker - not working

karan_alang1 — Tue, 19 Dec 2017 07:27:58 GMT

i'm setting up Kafka Mirror Maker - to transfer data between 2 clusters, and somehow it seems the MirrorMaker is not able to pull data from the Producer cluster.

Here is the command used :

$CONFLUENT/bin/kafka-mirror-maker --consumer.config $CONFLUENT/mprops/mmConsumer-qa.properties --producer.config $CONFLUENT/mprops/mmProducer-qa.properties --whitelist="mmtest" --new.consumer --num.streams 4

mmConsumer-qa.properties :
bootstrap.servers=localhost:7092, localhost:7082,localhost:7072
group.id=mmtest
client.id=mm_consumer

mmProducer-qa.properties :
bootstrap.servers=localhost:8092
acks=1
batch.size=100
client.id=mm_producer
linger.ms=5

Any ideas on how to debug/fix this ?

Re: Kafka MirrorMaker - not working

karan_alang1 — Tue, 19 Dec 2017 07:28:36 GMT

@Sriharsha Chintalapani - any ideas on this ?

Re: Kafka MirrorMaker - not working

karan_alang1 — Tue, 19 Dec 2017 07:41:04 GMT

the issue is fixed, the consumer config file - should have the producer bootstrap servers, while the producer config file - should have the consumer bootstrap server. i'd mixed up the 2, reversing that fixed the issue.