Kafka does not start after Kerborising the clustrer

[#1]

All my HDP components succeded to start after kerborising my cluster, except Kakfa...

This is what I can see in /var/log/kafka/server.log:

[2016-01-06 23:04:54,931] FATAL Fatal error during KafkaServer startup. Prepare to shutdown (kafka.server.KafkaServer) java.lang.IllegalArgumentException: You must pass java.security.auth.login.config in secure mode. at org.apache.kafka.common.security.kerberos.Login.login(Login.java:297)

Ambari logs do not show any error message related to the Kafka fail while restarting the service.

I am running HDP 2.3 and Ambari 2.1

Any clue ?

[#2 · Accepted solution]

export KAFKA_KERBEROS_PARAMS in /usr/hdp/current/kafka-broker/config/kafka-env.sh you can do this using ambari as well look for kafka-env config template under kafka service.

KAFKA_KERBEROS_PARAMS="-Djava.security.auth.login.config=/usr/hdp/current/kafka-broker/config/kafka_jaas.conf"

[#3]

Thank you ! That was fast 🙂

[#4]

@Ali Gouta Schintalapani is Kafka committer 😉 http://kafka.apache.org/committers.html

[#5]

Kafka is getting started, but through java application I am not able to send message to kafka topic, I have already passed principalName and keytab through application. and set one property CommonClientConfigs.SECURITY_PROTOCOL_CONFIG, "PLAINTEXTSASL",

it gives same error - You must pass java.security.auth.login.config in secure mode

[#6]

Thanks for this post. kudos!

[#7]

Thanks...helped me out right away!