Support Questions
Find answers, ask questions, and share your expertise

Kafka MirrorMaker error

Expert Contributor
Hi All,I'm trying to transfer data between kafka clusters using Kafka MirrorMaker & running into issues.I've created a consumer.config & producer.config files & using the command shown below. </n> The error indicates - equirement failed: Missing required property 'zookeeper.connect' ------------------------------CommandLine error -----------------------------
$KAFKA10_HOME/bin/kafka-run-class.sh kafka.tools.MirrorMaker --consumer.config $KAFKA10_HOME/config/mmConsumer.config --num.streams 2 --producer.config $KAFKA10_HOME/config/mmProducer.config --whitelist="mmtopic" [2017-06-08 11:32:55,962] ERROR Exception when starting mirror maker. (kafka.tools.MirrorMaker$) java.lang.IllegalArgumentException: requirement failed: Missing required property 'zookeeper.connect' at scala.Predef$.require(Predef.scala:224) at kafka.utils.VerifiableProperties.getString(VerifiableProperties.scala:177) at kafka.utils.ZKConfig.<init>(ZkUtils.scala:902) at kafka.consumer.ConsumerConfig.<init>(ConsumerConfig.scala:101) at kafka.consumer.ConsumerConfig.<init>(ConsumerConfig.scala:105) at kafka.tools.MirrorMaker$$anonfun$3.apply(MirrorMaker.scala:306) at kafka.tools.MirrorMaker$$anonfun$3.apply(MirrorMaker.scala:304) at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234) at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234) at scala.collection.immutable.Range.foreach(Range.scala:160) at scala.collection.TraversableLike$class.map(TraversableLike.scala:234) at scala.collection.AbstractTraversable.map(Traversable.scala:104) at kafka.tools.MirrorMaker$.createOldConsumers(MirrorMaker.scala:304) at kafka.tools.MirrorMaker$.main(MirrorMaker.scala:233) at kafka.tools.MirrorMaker.main(MirrorMaker.scala) Exception in thread "main" java.lang.NullPointerException at kafka.tools.MirrorMaker$.main(MirrorMaker.scala:286) at kafka.tools.MirrorMaker.main(MirrorMaker.scala)
I tried adding the option (-zookeeper.connect = localhost:21810), it gives error -> zookeeper.connect is not a recognized option ----------------------------- CommandLine Error ------------------------- [2017-06-08 11:40:11,033] ERROR Exception when starting mirror maker. (kafka.tools.MirrorMaker$) joptsimple.UnrecognizedOptionException: zookeeper.connect is not a recognized option at joptsimple.OptionException.unrecognizedOption(OptionException.java:108) at joptsimple.OptionParser.handleLongOptionToken(OptionParser.java:449) at joptsimple.OptionParserState$2.handleArgument(OptionParserState.java:56) at joptsimple.OptionParser.parse(OptionParser.java:381) at kafka.tools.MirrorMaker$.main(MirrorMaker.scala:167) at kafka.tools.MirrorMaker.main(MirrorMaker.scala) Exception in thread "main" java.lang.NullPointerException at kafka.tools.MirrorMaker$.main(MirrorMaker.scala:286) at kafka.tools.MirrorMaker.main(MirrorMaker.scala) Any ideas on what needs to be done ?
1 ACCEPTED SOLUTION

Accepted Solutions

Contributor

@Karan Alang If you are using the new Kafka Consumer, try bootstrap.servers and see if that helps.

Check https://community.hortonworks.com/articles/24599/kafka-mirrormaker.html for more details.

View solution in original post

2 REPLIES 2

Contributor

@Karan Alang If you are using the new Kafka Consumer, try bootstrap.servers and see if that helps.

Check https://community.hortonworks.com/articles/24599/kafka-mirrormaker.html for more details.

View solution in original post

Expert Contributor

@schandhok - thnx, that fixed the issue.