Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Kafka MirrorMaker - not working

Solved Go to solution

Kafka MirrorMaker - not working

Expert Contributor

i'm setting up Kafka Mirror Maker - to transfer data between 2 clusters, and somehow it seems the MirrorMaker is not able to pull data from the Producer cluster.

Here is the command used :

$CONFLUENT/bin/kafka-mirror-maker --consumer.config $CONFLUENT/mprops/mmConsumer-qa.properties --producer.config $CONFLUENT/mprops/mmProducer-qa.properties --whitelist="mmtest" --new.consumer --num.streams 4
mmConsumer-qa.properties :
bootstrap.servers=localhost:7092, localhost:7082,localhost:7072
group.id=mmtest
client.id=mm_consumer

mmProducer-qa.properties :
bootstrap.servers=localhost:8092
acks=1
batch.size=100
client.id=mm_producer
linger.ms=5

Any ideas on how to debug/fix this ?

1 ACCEPTED SOLUTION

Accepted Solutions

Re: Kafka MirrorMaker - not working

Expert Contributor

the issue is fixed, the consumer config file - should have the producer bootstrap servers, while the producer config file - should have the consumer bootstrap server. i'd mixed up the 2, reversing that fixed the issue.

2 REPLIES 2
Highlighted

Re: Kafka MirrorMaker - not working

Expert Contributor

@Sriharsha Chintalapani - any ideas on this ?

Re: Kafka MirrorMaker - not working

Expert Contributor

the issue is fixed, the consumer config file - should have the producer bootstrap servers, while the producer config file - should have the consumer bootstrap server. i'd mixed up the 2, reversing that fixed the issue.

Don't have an account?
Coming from Hortonworks? Activate your account here