Console producer/consumer not working in kafka 0.10.2 with kerberos

[#1]

Hi,

We have recently started using kafka 0.10.2 but are unable to produce any messages or consumer them. It has kerberos enabled. Below are my configs. There is no error and kafka data log also doesn't have any entry but the index gets updated whenever we run an producer.

kafka-console-producer --broker-list kafka1.test.com:9092,kafka2.test.com:9092 --producer.config client.properties --topic TEST

kafka-console-consumer --topic TEST --from-beginning --bootstrap-server kafka1.test.com:9092,kafka2.test.com:9092 --consumer.config consumer.properties

jass:

KafkaClient { com.sun.security.auth.module.Krb5LoginModule required useTicketCache=true; };

client.properties/consumer.properties:

security.protocol=SASL_PLAINTEXT

sasl.kerberos.service.name=kafka

[#2]

The issue actually seems to be with the kafka root in zookeeper. Initially the kafka root was / and then we changed it to /kafkapre in zookeeper. But kafka seems to be searching for / itself still.

2017-11-23 09:16:12,539 WARN nl.techop.kafka.dao.zookeeper.KafkaZkClient: KeeperErrorCode = NoNode for /brokers/topics/TEST/partitions/1/state

2017-11-23 09:17:42,548 WARN nl.techop.kafka.dao.zookeeper.KafkaZkClient: KeeperErrorCode = NoNode for /brokers/topics/TEST/partitions/1/state

2017-11-23 09:19:12,533 WARN nl.techop.kafka.dao.zookeeper.KafkaZkClient: KeeperErrorCode = NoNode for /brokers/topics/TEST/partitions/1/state

[#3]

@Rajesh Reddy

1. Is your Kafka broker security protocol using PLAINTEXT? But when you consume/produce you used SASL_PLAINTEXT (client.properties/consumer.properties) ?
2. Maybe you can try disable kerberos security and try whether Kafka working or not in none-security mode then only enable to security for further testing.
3. Since you do not have ranger policy, I think the account that you're using should be okay. But prefer use the same account for troubleshooting