Archives of Support Questions (Read Only)

This is an archived board for historical reference. Information and links may no longer be available or relevant
Announcements
This board is archived and read-only for historical reference. To ask a new question, please post a new topic on the appropriate active board.

Kafka MirrorMaker error

avatar
Expert Contributor
Hi All,I'm trying to transfer data between kafka clusters using Kafka MirrorMaker & running into issues.I've created a consumer.config & producer.config files & using the command shown below. </n> The error indicates - equirement failed: Missing required property 'zookeeper.connect' ------------------------------CommandLine error -----------------------------
$KAFKA10_HOME/bin/kafka-run-class.sh kafka.tools.MirrorMaker --consumer.config $KAFKA10_HOME/config/mmConsumer.config --num.streams 2 --producer.config $KAFKA10_HOME/config/mmProducer.config --whitelist="mmtopic" [2017-06-08 11:32:55,962] ERROR Exception when starting mirror maker. (kafka.tools.MirrorMaker$) java.lang.IllegalArgumentException: requirement failed: Missing required property 'zookeeper.connect' at scala.Predef$.require(Predef.scala:224) at kafka.utils.VerifiableProperties.getString(VerifiableProperties.scala:177) at kafka.utils.ZKConfig.<init>(ZkUtils.scala:902) at kafka.consumer.ConsumerConfig.<init>(ConsumerConfig.scala:101) at kafka.consumer.ConsumerConfig.<init>(ConsumerConfig.scala:105) at kafka.tools.MirrorMaker$$anonfun$3.apply(MirrorMaker.scala:306) at kafka.tools.MirrorMaker$$anonfun$3.apply(MirrorMaker.scala:304) at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234) at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234) at scala.collection.immutable.Range.foreach(Range.scala:160) at scala.collection.TraversableLike$class.map(TraversableLike.scala:234) at scala.collection.AbstractTraversable.map(Traversable.scala:104) at kafka.tools.MirrorMaker$.createOldConsumers(MirrorMaker.scala:304) at kafka.tools.MirrorMaker$.main(MirrorMaker.scala:233) at kafka.tools.MirrorMaker.main(MirrorMaker.scala) Exception in thread "main" java.lang.NullPointerException at kafka.tools.MirrorMaker$.main(MirrorMaker.scala:286) at kafka.tools.MirrorMaker.main(MirrorMaker.scala)
I tried adding the option (-zookeeper.connect = localhost:21810), it gives error -> zookeeper.connect is not a recognized option ----------------------------- CommandLine Error ------------------------- [2017-06-08 11:40:11,033] ERROR Exception when starting mirror maker. (kafka.tools.MirrorMaker$) joptsimple.UnrecognizedOptionException: zookeeper.connect is not a recognized option at joptsimple.OptionException.unrecognizedOption(OptionException.java:108) at joptsimple.OptionParser.handleLongOptionToken(OptionParser.java:449) at joptsimple.OptionParserState$2.handleArgument(OptionParserState.java:56) at joptsimple.OptionParser.parse(OptionParser.java:381) at kafka.tools.MirrorMaker$.main(MirrorMaker.scala:167) at kafka.tools.MirrorMaker.main(MirrorMaker.scala) Exception in thread "main" java.lang.NullPointerException at kafka.tools.MirrorMaker$.main(MirrorMaker.scala:286) at kafka.tools.MirrorMaker.main(MirrorMaker.scala) Any ideas on what needs to be done ?
1 ACCEPTED SOLUTION

avatar
Rising Star

@Karan Alang If you are using the new Kafka Consumer, try bootstrap.servers and see if that helps.

Check https://community.hortonworks.com/articles/24599/kafka-mirrormaker.html for more details.

View solution in original post

2 REPLIES 2

avatar
Rising Star

@Karan Alang If you are using the new Kafka Consumer, try bootstrap.servers and see if that helps.

Check https://community.hortonworks.com/articles/24599/kafka-mirrormaker.html for more details.

avatar
Expert Contributor

@schandhok - thnx, that fixed the issue.