Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Kafka MirrorMaker - not working

Solved Go to solution
Highlighted

Kafka MirrorMaker - not working

Expert Contributor

i'm setting up Kafka Mirror Maker - to transfer data between 2 clusters, and somehow it seems the MirrorMaker is not able to pull data from the Producer cluster.

Here is the command used :

$CONFLUENT/bin/kafka-mirror-maker --consumer.config $CONFLUENT/mprops/mmConsumer-qa.properties --producer.config $CONFLUENT/mprops/mmProducer-qa.properties --whitelist="mmtest" --new.consumer --num.streams 4
mmConsumer-qa.properties :
bootstrap.servers=localhost:7092, localhost:7082,localhost:7072
group.id=mmtest
client.id=mm_consumer

mmProducer-qa.properties :
bootstrap.servers=localhost:8092
acks=1
batch.size=100
client.id=mm_producer
linger.ms=5

Any ideas on how to debug/fix this ?

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted

Re: Kafka MirrorMaker - not working

Expert Contributor

the issue is fixed, the consumer config file - should have the producer bootstrap servers, while the producer config file - should have the consumer bootstrap server. i'd mixed up the 2, reversing that fixed the issue.

View solution in original post

2 REPLIES 2
Highlighted

Re: Kafka MirrorMaker - not working

Expert Contributor

@Sriharsha Chintalapani - any ideas on this ?

Highlighted

Re: Kafka MirrorMaker - not working

Expert Contributor

the issue is fixed, the consumer config file - should have the producer bootstrap servers, while the producer config file - should have the consumer bootstrap server. i'd mixed up the 2, reversing that fixed the issue.

View solution in original post

Don't have an account?
Coming from Hortonworks? Activate your account here