Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Kafka MirrorMaker error

Solved Go to solution

Kafka MirrorMaker error

Expert Contributor
Hi All,I'm trying to transfer data between kafka clusters using Kafka MirrorMaker & running into issues.I've created a consumer.config & producer.config files & using the command shown below. </n> The error indicates - equirement failed: Missing required property 'zookeeper.connect' ------------------------------CommandLine error -----------------------------
$KAFKA10_HOME/bin/kafka-run-class.sh kafka.tools.MirrorMaker --consumer.config $KAFKA10_HOME/config/mmConsumer.config --num.streams 2 --producer.config $KAFKA10_HOME/config/mmProducer.config --whitelist="mmtopic" [2017-06-08 11:32:55,962] ERROR Exception when starting mirror maker. (kafka.tools.MirrorMaker$) java.lang.IllegalArgumentException: requirement failed: Missing required property 'zookeeper.connect' at scala.Predef$.require(Predef.scala:224) at kafka.utils.VerifiableProperties.getString(VerifiableProperties.scala:177) at kafka.utils.ZKConfig.<init>(ZkUtils.scala:902) at kafka.consumer.ConsumerConfig.<init>(ConsumerConfig.scala:101) at kafka.consumer.ConsumerConfig.<init>(ConsumerConfig.scala:105) at kafka.tools.MirrorMaker$$anonfun$3.apply(MirrorMaker.scala:306) at kafka.tools.MirrorMaker$$anonfun$3.apply(MirrorMaker.scala:304) at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234) at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234) at scala.collection.immutable.Range.foreach(Range.scala:160) at scala.collection.TraversableLike$class.map(TraversableLike.scala:234) at scala.collection.AbstractTraversable.map(Traversable.scala:104) at kafka.tools.MirrorMaker$.createOldConsumers(MirrorMaker.scala:304) at kafka.tools.MirrorMaker$.main(MirrorMaker.scala:233) at kafka.tools.MirrorMaker.main(MirrorMaker.scala) Exception in thread "main" java.lang.NullPointerException at kafka.tools.MirrorMaker$.main(MirrorMaker.scala:286) at kafka.tools.MirrorMaker.main(MirrorMaker.scala)
I tried adding the option (-zookeeper.connect = localhost:21810), it gives error -> zookeeper.connect is not a recognized option ----------------------------- CommandLine Error ------------------------- [2017-06-08 11:40:11,033] ERROR Exception when starting mirror maker. (kafka.tools.MirrorMaker$) joptsimple.UnrecognizedOptionException: zookeeper.connect is not a recognized option at joptsimple.OptionException.unrecognizedOption(OptionException.java:108) at joptsimple.OptionParser.handleLongOptionToken(OptionParser.java:449) at joptsimple.OptionParserState$2.handleArgument(OptionParserState.java:56) at joptsimple.OptionParser.parse(OptionParser.java:381) at kafka.tools.MirrorMaker$.main(MirrorMaker.scala:167) at kafka.tools.MirrorMaker.main(MirrorMaker.scala) Exception in thread "main" java.lang.NullPointerException at kafka.tools.MirrorMaker$.main(MirrorMaker.scala:286) at kafka.tools.MirrorMaker.main(MirrorMaker.scala) Any ideas on what needs to be done ?
1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted

Re: Kafka MirrorMaker error

Contributor

@Karan Alang If you are using the new Kafka Consumer, try bootstrap.servers and see if that helps.

Check https://community.hortonworks.com/articles/24599/kafka-mirrormaker.html for more details.

View solution in original post

2 REPLIES 2
Highlighted

Re: Kafka MirrorMaker error

Contributor

@Karan Alang If you are using the new Kafka Consumer, try bootstrap.servers and see if that helps.

Check https://community.hortonworks.com/articles/24599/kafka-mirrormaker.html for more details.

View solution in original post

Highlighted

Re: Kafka MirrorMaker error

Expert Contributor

@schandhok - thnx, that fixed the issue.

Don't have an account?
Coming from Hortonworks? Activate your account here