Support Questions
Find answers, ask questions, and share your expertise
Announcements
Check out our newest addition to the community, the Cloudera Innovation Accelerator group hub.

How to configure Mirror Make 2.0 for kerberized cluster

Rising Star

Hi Team ,

 

Can you suggest me documentation around on how can i use Mirror Maker 2.0 with kerberized Kafka cluster . I tried below configs but its not working

 

below is the properties file

 

# Kafka datacenters.
clusters = source, target
source.bootstrap.servers = yy:9092,yy:9092
target.bootstrap.servers = xx:9092,xx:9092
source.security.protocol= SASL_PLAINTEXT
source.sasl.mechanism= GSSAPI
#sasl.jaas.config= com.sun.security.auth.module.Krb5LoginModule required
source.sasl.jaas.config= com.sun.security.auth.module.Krb5LoginModule required \
useKeyTab= true \
storeKey= true \
keyTab= xx.keytab \
principal= xx ;
source.sasl.kerberos.service.name= kafka
# Source and target cluster configurations.
source.config.storage.replication.factor = 1
target.config.storage.replication.factor = 1
source.offset.storage.replication.factor = 1
target.offset.storage.replication.factor = 1
source.status.storage.replication.factor = 1
target.status.storage.replication.factor = 1
source->target.enabled = true
target->source.enabled = false
# Mirror maker configurations.
offset-syncs.topic.replication.factor = 1
heartbeats.topic.replication.factor = 1
checkpoints.topic.replication.factor = 1
topics = xxx
groups = .*
tasks.max = 1
replication.factor = 1
refresh.topics.enabled = false
sync.topic.configs.enabled = true
refresh.topics.interval.seconds = 30
topics.blacklist = .*[\-\.]internal, .*\.replica, __consumer_offsets
groups.blacklist = console-consumer-.*, connect-.*, __.*

 

 

Error i am getting :-

[2021-03-09 12:31:36,042] ERROR Stopping due to error (org.apache.kafka.connect.mirror.MirrorMaker:304)
org.apache.kafka.connect.errors.ConnectException: Failed to connect to and describe Kafka cluster. Check worker's broker connection and security properties.
at org.apache.kafka.connect.util.ConnectUtils.lookupKafkaClusterId(ConnectUtils.java:70)
at org.apache.kafka.connect.util.ConnectUtils.lookupKafkaClusterId(ConnectUtils.java:51)
at org.apache.kafka.connect.mirror.MirrorMaker.addHerder(MirrorMaker.java:235)
at org.apache.kafka.connect.mirror.MirrorMaker.lambda$new$1(MirrorMaker.java:136)
at java.lang.Iterable.forEach(Iterable.java:75)
at org.apache.kafka.connect.mirror.MirrorMaker.<init>(MirrorMaker.java:136)
at org.apache.kafka.connect.mirror.MirrorMaker.<init>(MirrorMaker.java:148)
at org.apache.kafka.connect.mirror.MirrorMaker.main(MirrorMaker.java:291)
Caused by: java.util.concurrent.ExecutionException: org.apache.kafka.common.errors.TimeoutException: Call(callName=listNodes, deadlineMs=1615311096033, tries=1, nextAllowedTryMs=1615311096134) timed out at 1615311096034 after 1 attempt(s)
at org.apache.kafka.common.internals.KafkaFutureImpl.wrapAndThrow(KafkaFutureImpl.java:45)
at org.apache.kafka.common.internals.KafkaFutureImpl.access$000(KafkaFutureImpl.java:32)
at org.apache.kafka.common.internals.KafkaFutureImpl$SingleWaiter.await(KafkaFutureImpl.java:89)
at org.apache.kafka.common.internals.KafkaFutureImpl.get(KafkaFutureImpl.java:260)
at org.apache.kafka.connect.util.ConnectUtils.lookupKafkaClusterId(ConnectUtils.java:64)
... 7 more

1 REPLY 1

Contributor

Hello @bhara,

 

Do you have Ranger enabled?

What is the Data center version? (I see a bug OPSAPS-58584 on 7.1.5 which was fixed in 7.2.4 , 7.3.0 )

 

 

SME || Kafka | Schema Registry | SMM | SRM