Hi Team ,
Can you suggest me documentation around on how can i use Mirror Maker 2.0 with kerberized Kafka cluster . I tried below configs but its not working
below is the properties file
# Kafka datacenters.
clusters = source, target
source.bootstrap.servers = yy:9092,yy:9092
target.bootstrap.servers = xx:9092,xx:9092
source.security.protocol= SASL_PLAINTEXT
source.sasl.mechanism= GSSAPI
#sasl.jaas.config= com.sun.security.auth.module.Krb5LoginModule required
source.sasl.jaas.config= com.sun.security.auth.module.Krb5LoginModule required \
useKeyTab= true \
storeKey= true \
keyTab= xx.keytab \
principal= xx ;
source.sasl.kerberos.service.name= kafka
# Source and target cluster configurations.
source.config.storage.replication.factor = 1
target.config.storage.replication.factor = 1
source.offset.storage.replication.factor = 1
target.offset.storage.replication.factor = 1
source.status.storage.replication.factor = 1
target.status.storage.replication.factor = 1
source->target.enabled = true
target->source.enabled = false
# Mirror maker configurations.
offset-syncs.topic.replication.factor = 1
heartbeats.topic.replication.factor = 1
checkpoints.topic.replication.factor = 1
topics = xxx
groups = .*
tasks.max = 1
replication.factor = 1
refresh.topics.enabled = false
sync.topic.configs.enabled = true
refresh.topics.interval.seconds = 30
topics.blacklist = .*[\-\.]internal, .*\.replica, __consumer_offsets
groups.blacklist = console-consumer-.*, connect-.*, __.*
Error i am getting :-
[2021-03-09 12:31:36,042] ERROR Stopping due to error (org.apache.kafka.connect.mirror.MirrorMaker:304)
org.apache.kafka.connect.errors.ConnectException: Failed to connect to and describe Kafka cluster. Check worker's broker connection and security properties.
at org.apache.kafka.connect.util.ConnectUtils.lookupKafkaClusterId(ConnectUtils.java:70)
at org.apache.kafka.connect.util.ConnectUtils.lookupKafkaClusterId(ConnectUtils.java:51)
at org.apache.kafka.connect.mirror.MirrorMaker.addHerder(MirrorMaker.java:235)
at org.apache.kafka.connect.mirror.MirrorMaker.lambda$new$1(MirrorMaker.java:136)
at java.lang.Iterable.forEach(Iterable.java:75)
at org.apache.kafka.connect.mirror.MirrorMaker.<init>(MirrorMaker.java:136)
at org.apache.kafka.connect.mirror.MirrorMaker.<init>(MirrorMaker.java:148)
at org.apache.kafka.connect.mirror.MirrorMaker.main(MirrorMaker.java:291)
Caused by: java.util.concurrent.ExecutionException: org.apache.kafka.common.errors.TimeoutException: Call(callName=listNodes, deadlineMs=1615311096033, tries=1, nextAllowedTryMs=1615311096134) timed out at 1615311096034 after 1 attempt(s)
at org.apache.kafka.common.internals.KafkaFutureImpl.wrapAndThrow(KafkaFutureImpl.java:45)
at org.apache.kafka.common.internals.KafkaFutureImpl.access$000(KafkaFutureImpl.java:32)
at org.apache.kafka.common.internals.KafkaFutureImpl$SingleWaiter.await(KafkaFutureImpl.java:89)
at org.apache.kafka.common.internals.KafkaFutureImpl.get(KafkaFutureImpl.java:260)
at org.apache.kafka.connect.util.ConnectUtils.lookupKafkaClusterId(ConnectUtils.java:64)
... 7 more
