Error while reading data from kafka topic

djjai27 — Sat, 02 Jul 2016 01:13:10 GMT

We recently upgraded out Hadoop cluster from 6.2.6 to 6.3.4 and i am getting the below error while trying to read data from kafka-topic. Any help to resolve this issue is highly appreciated.

$KAFKA_HOME/bin/kafka-console-consumer.sh --zookeeper xxxxxxx:2181 --topic xxxxxxxxxxxx

SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/usr/hdp/2.3.4.7-4/kafka/libs/slf4j-log4j12-1.7.6.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/usr/hdp/2.3.4.7-4/phoenix/phoenix-4.4.0.2.3.4.7-4-client.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] [2016-07-01 12:55:01,829] WARN SASL configuration failed: javax.security.auth.login.LoginException: Zookeeper client cannot authenticate using the 'Client' section of the supplied JAAS configuration: '/usr/hdp/current/kafka-broker/config/kafka_client_jaas.conf' because of a RuntimeException: java.lang.SecurityException: /usr/hdp/current/kafka-broker/config/kafka_client_jaas.conf (No such file or directory) Will continue connection to Zookeeper server without SASL authentication, if Zookeeper server allows it. (org.apache.zookeeper.ClientCnxn) [2016-07-01 12:55:02,062] ERROR Unknown error when running consumer: (kafka.tools.ConsoleConsumer$) org.apache.kafka.common.KafkaException: File /usr/hdp/current/kafka-broker/config/kafka_client_jaas.confcannot be read. at org.apache.kafka.common.security.JaasUtils.isZkSecurityEnabled(JaasUtils.java:95) at kafka.consumer.ZookeeperConsumerConnector.connectZk(ZookeeperConsumerConnector.scala:200) at kafka.consumer.ZookeeperConsumerConnector.<init>(ZookeeperConsumerConnector.scala:145) at kafka.consumer.ZookeeperConsumerConnector.<init>(ZookeeperConsumerConnector.scala:162) at kafka.consumer.Consumer$.create(ConsumerConnector.scala:109) at kafka.consumer.OldConsumer.<init>(BaseConsumer.scala:82) at kafka.tools.ConsoleConsumer$.run(ConsoleConsumer.scala:63) at kafka.tools.ConsoleConsumer$.main(ConsoleConsumer.scala:47) at kafka.tools.ConsoleConsumer.main(ConsoleConsumer.scala)

Thanks.

Re: Error while reading data from kafka topic

mkumar13 — Sun, 03 Jul 2016 00:29:48 GMT

This error seems to appear when we add cluster to secure cluster. Could you please verify your authentication capability to Kafka brokers added for encryption with this upgrade.

question Error while reading data from kafka topic in Archives of Support Questions (Read Only)

Error while reading data from kafka topic

Re: Error while reading data from kafka topic