Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Kafka MirrorMaker error

avatar
Expert Contributor
Hi All,I'm trying to transfer data between kafka clusters using Kafka MirrorMaker & running into issues.I've created a consumer.config & producer.config files & using the command shown below. </n> The error indicates - equirement failed: Missing required property 'zookeeper.connect' ------------------------------CommandLine error -----------------------------
$KAFKA10_HOME/bin/kafka-run-class.sh kafka.tools.MirrorMaker --consumer.config $KAFKA10_HOME/config/mmConsumer.config --num.streams 2 --producer.config $KAFKA10_HOME/config/mmProducer.config --whitelist="mmtopic" [2017-06-08 11:32:55,962] ERROR Exception when starting mirror maker. (kafka.tools.MirrorMaker$) java.lang.IllegalArgumentException: requirement failed: Missing required property 'zookeeper.connect' at scala.Predef$.require(Predef.scala:224) at kafka.utils.VerifiableProperties.getString(VerifiableProperties.scala:177) at kafka.utils.ZKConfig.<init>(ZkUtils.scala:902) at kafka.consumer.ConsumerConfig.<init>(ConsumerConfig.scala:101) at kafka.consumer.ConsumerConfig.<init>(ConsumerConfig.scala:105) at kafka.tools.MirrorMaker$$anonfun$3.apply(MirrorMaker.scala:306) at kafka.tools.MirrorMaker$$anonfun$3.apply(MirrorMaker.scala:304) at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234) at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234) at scala.collection.immutable.Range.foreach(Range.scala:160) at scala.collection.TraversableLike$class.map(TraversableLike.scala:234) at scala.collection.AbstractTraversable.map(Traversable.scala:104) at kafka.tools.MirrorMaker$.createOldConsumers(MirrorMaker.scala:304) at kafka.tools.MirrorMaker$.main(MirrorMaker.scala:233) at kafka.tools.MirrorMaker.main(MirrorMaker.scala) Exception in thread "main" java.lang.NullPointerException at kafka.tools.MirrorMaker$.main(MirrorMaker.scala:286) at kafka.tools.MirrorMaker.main(MirrorMaker.scala)
I tried adding the option (-zookeeper.connect = localhost:21810), it gives error -> zookeeper.connect is not a recognized option ----------------------------- CommandLine Error ------------------------- [2017-06-08 11:40:11,033] ERROR Exception when starting mirror maker. (kafka.tools.MirrorMaker$) joptsimple.UnrecognizedOptionException: zookeeper.connect is not a recognized option at joptsimple.OptionException.unrecognizedOption(OptionException.java:108) at joptsimple.OptionParser.handleLongOptionToken(OptionParser.java:449) at joptsimple.OptionParserState$2.handleArgument(OptionParserState.java:56) at joptsimple.OptionParser.parse(OptionParser.java:381) at kafka.tools.MirrorMaker$.main(MirrorMaker.scala:167) at kafka.tools.MirrorMaker.main(MirrorMaker.scala) Exception in thread "main" java.lang.NullPointerException at kafka.tools.MirrorMaker$.main(MirrorMaker.scala:286) at kafka.tools.MirrorMaker.main(MirrorMaker.scala) Any ideas on what needs to be done ?
1 ACCEPTED SOLUTION

avatar
Rising Star

@Karan Alang If you are using the new Kafka Consumer, try bootstrap.servers and see if that helps.

Check https://community.hortonworks.com/articles/24599/kafka-mirrormaker.html for more details.

View solution in original post

2 REPLIES 2

avatar
Rising Star

@Karan Alang If you are using the new Kafka Consumer, try bootstrap.servers and see if that helps.

Check https://community.hortonworks.com/articles/24599/kafka-mirrormaker.html for more details.

avatar
Expert Contributor

@schandhok - thnx, that fixed the issue.