Support Questions
Find answers, ask questions, and share your expertise
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Issue with Kafka Kerberos+SSL


Issue with Kafka Kerberos+SSL

New Contributor

On HDP 26 cluster, I have installed Kafka, and enable Kerberos+SSL on it. But when I run "get /brokers/ids/1002" I get below value

The host and the port information is not getting configured. I tried configuring these( and advertised.port) through ambari as well as setting proprty in file and restarting the kafka manually but it is not getting reflected.

But, if i change the protocol from PLAINTEXTSASL/SASL_PLAINTEXT to simply PLAINTEXT then the host and port information is gets updated correctly as below.

get /brokers/ids/1002


I have tried to update the endpoint manually, but still does not work.

I used consumer command:

/usr/hdp/ --new-consumer --bootstrap-server hostname:6668 --topic testTopic --from-beginning --security-protocol SASL_SSL --consumer.config /usr/hdp/current/kafka-broker/config/

I get below error:
[2018-02-02 09:58:49,475] WARN Error while fetching metadata with correlation id 479 : {testTopic=UNKNOWN_TOPIC_OR_PARTITION} (org.apache.kafka.clients.NetworkClient)

I used producer command:

/usr/hdp/current/kafka-broker/bin/ --broker-list hostname:6668 --topic testTopic --producer-property "security.protocol=SASL_SSL" --producer.config /usr/hdp/current/kafka-broker/config/

But when I type string on it, I got below error:

[2018-02-02 09:36:10,674] WARN Bootstrap broker tal-qa16.talend.lan:6668 disconnected (org.apache.kafka.clients.NetworkClient)
[2018-02-02 09:36:10,960] WARN Bootstrap broker tal-qa16.talend.lan:6668 disconnected (org.apache.kafka.clients.NetworkClient)

Seems my problem is similar with, but the solution does not work for me.

So can you help me check?

Don't have an account?
Coming from Hortonworks? Activate your account here