question Re: Connecting third party tool to Secure Kafka cluster from outside in Archives of Support Questions (Read Only)

Connecting third party tool to Secure Kafka cluster from outside

smartninja723 — Thu, 15 Sep 2016 18:23:59 GMT

Guys,

We have setup Kerberized cluster (HDP 2.4.x) and have setup Kafka Broker(0.9.x) with SASL (kerberization).

What are the steps required to connect third party tool (producers/publishers) to connect to Kafka?

Going through the link : https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.4.2/bk_secure-kafka-ambari/content/ch_secure-kafka-config-options.html

What I understand is : this tool needs access to JAAS.conf file. For now I've copied the /usr/hdp/current/kafka-broker/config/kafka_client_jaas.conf and shared with the third party tool and kept on the classpath.

Do we need anything else also in place?

Regards,

Re: Connecting third party tool to Secure Kafka cluster from outside

hkropp — Thu, 15 Sep 2016 18:48:30 GMT

@Smart Solutions could you please check if this article is of any help for you:

https://community.hortonworks.com/content/kbentry/56704/secure-kafka-java-producer-with-kerberos.html

Re: Connecting third party tool to Secure Kafka cluster from outside

bbende — Thu, 15 Sep 2016 19:44:45 GMT

Kafka's documentation explains how to configure client's for secure connections with SASL:

http://kafka.apache.org/documentation.html#security_sasl_clientconfig

You need to set a system property on your producer/consumer application to specify the JAAS file:

-Djava.security.auth.login.config=/etc/kafka/kafka_client_jaas.conf

Re: Connecting third party tool to Secure Kafka cluster from outside

smartninja723 — Thu, 15 Sep 2016 22:06:43 GMT

Thanks guys,

The missing bit was Kerberbos libraries on the third party machine where we are running the publishing application.

Thanks,

Re: Connecting third party tool to Secure Kafka cluster from outside

ranjithgangam1 — Fri, 20 Oct 2017 20:46:28 GMT

@Smart Solutions

I am trying to implement similar thing. I am trying to connect to kafka (0.10) from java producer program outside edge node. I tested my produce program in edge node it is working. But it is not working outside edge node. I have valid kerberos ticket outside edge node and passed jaas_conf file? Can you explain your approach or any example you took as reference.