Kafka | MirrorMaker | Kerberos

[#1]

Team,

I am receiving following an error while executing kafka mirror-maker command. Kerberos is configured on source and target cluster.

kafka@hdpensrv$ /usr/hdp/current/kafka-broker/bin/kafka-mirror-maker.sh --consumer.config /tmp/sourceClusterConsumer.properties --producer.config /tmp/targetClusterProducer.properties --whitelist="topic_test"

[2018-01-16 06:21:45,493] ERROR Exception when starting mirror maker. (kafka.tools.MirrorMaker$) org.apache.kafka.common.KafkaException: Failed to construct kafka producer at org.apache.kafka.clients.producer.KafkaProducer.<init>(KafkaProducer.java:335) at org.apache.kafka.clients.producer.KafkaProducer.<init>(KafkaProducer.java:188) at kafka.tools.MirrorMaker$MirrorMakerProducer.<init>(MirrorMaker.scala:626) at kafka.tools.MirrorMaker$.main(MirrorMaker.scala:213) at kafka.tools.MirrorMaker.main(MirrorMaker.scala) Caused by: org.apache.kafka.common.KafkaException: javax.security.auth.login.LoginException: Could not login: the client is being asked for a password, but the Kafka client code does not currently support obtaining a password from the user. not available to garner authentication information from the user at org.apache.kafka.common.network.SaslChannelBuilder.configure(SaslChannelBuilder.java:86) at org.apache.kafka.common.network.ChannelBuilders.create(ChannelBuilders.java:71) at org.apache.kafka.clients.ClientUtils.createChannelBuilder(ClientUtils.java:83) at org.apache.kafka.clients.producer.KafkaProducer.<init>(KafkaProducer.java:277) ... 4 more

[#2 · Accepted solution]

@Nilesh

Please refer this doc : https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.0/bk_kafka-component-guide/content/running-mi...

[#3]

@Sandeep Nemuri

I tried this URL. This document is not updated

[#4]

export KAFKA_CLIENT_KERBEROS_PARAMS="-Djava.security.auth.login.config=<path to jaas.conf>"

Try exporting the env variable before running the mirror maker.