Reply
Highlighted
Explorer
Posts: 10
Registered: ‎01-31-2017

Authenticate Kafka 2.02 mirror maker to Kafka 0.10 Cluster with SASL_SSL

I am trying to connect my MirroMaker Kafka 0.9 to the Kafka Brokers 0.10 (IBM Message Hub) without success. The links I have followed are the followings, but they are mostly for Kafka clients 0.10:

https://console.bluemix.net/docs/services/MessageHub/messagehub050.html#kafka_usinghttps://console.bluemix.net/docs/services/MessageHub/messagehub063.html#kafka_connect

Do you know the steps for Kafka clients 0.9 and how to use the MessageHubLoginModule and the jaas creation?

UPDATE

I follow the steps:

1) (Source Kafka Cluster's Security Protocol) source.security.protocol=SASL_SSL

While in Kafka MirrorMaker Advanced Configuration Snippet 
(Safety Valve) for mirror_maker_consumers.properties:
ssl.protocol=TLSv1.2
ssl.enabled.protocols=TLSv1.2

2) JAAS file in the Kafka directory: Additional MirrorMaker Java Options mirror_maker_java_opts=- Djava.security.auth.login.config="/opt/cloudera/parcels/KAFKA-2.0.2- 1.2.0.2.p0.5/jaas.conf"

3) JAR added in "/opt/cloudera/parcels/KAFKA-2.0.2- 1.2.0.2.p0.5/lib/kafka/libs/", where there are all the jars related to the Kafka service. Does Kafka load all the jars in that directory or I need to say it explicitly to Kafka somewhere?

4) JAAS file in the Kafka directory: Additional MirrorMaker Java Options mirror_maker_java_opts=- Djava.security.auth.login.config="/opt/cloudera/parcels/KAFKA-2.0.2- 1.2.0.2.p0.5/jaas.conf"

But still have errors, it looks like it search for something related to Kerberos auth.

Announcements

Currently incubating in Cloudera Labs:

Envelope
HTrace
Ibis
Impyla
Livy
Oryx
Phoenix
Spark Runner for Beam SDK
Time Series for Spark
YCSB