Reply
Cloudera Employee
Posts: 228
Registered: ‎01-09-2014

Re: Timeout Error When Using kafka-console-consumer and kafka-console-producer On Secured Cluster

[ Edited ]

This is indicating that your jaas.conf references a keytab that needs a password, or you are using ticket cache without doing a kinit before running this command.

Confirm that you are able to connect to the cluster (hdfs dfs -ls /) from the command line first, and then check your jaas.conf based on this documentation:
https://www.cloudera.com/documentation/kafka/latest/topics/kafka_security.html

-pd

Explorer
Posts: 11
Registered: ‎07-17-2017

Re: Timeout Error When Using kafka-console-consumer and kafka-console-producer On Secured Cluster

OK, finally got everything working.

 

As for the last error I had been seeing, I had thought for sure my kerberos credentials were still showing up in klist, but this morning when I kinited in, everything worked fine, so that must have been the issue.

 

I then got an error on the consumer side, which I soon realized was because with the new bootstrap-servers parameter, you need to use the same port as the producer (9093 in my case), not the zookeeper port. Once I updated this, everything worked properly.

New Contributor
Posts: 5
Registered: ‎11-16-2017

Re: Timeout Error When Using kafka-console-consumer and kafka-console-producer On Secured Cluster

 hi,

 

i have an issue on kafka, while running the stream from producer to consumer facing an error ,

 


org.apache.kafka.common.errors.TimeoutException: Failed to update metadata after 60000 ms
ERROR Error when sending message to topic binary_kafka_source with key: null, value: 175 bytes with error: (org.apache.kafka.clients.producer.internals.ErrorLoggingCallback)
 
 
please any one can help
 
New Contributor
Posts: 5
Registered: ‎11-16-2017

Re: Timeout Error When Using kafka-console-consumer and kafka-console-producer On Secured Cluster

and
7/11/16 12:23:23 INFO zkclient.ZkClient: zookeeper state changed (Disconnected)
17/11/16 12:23:23 INFO zkclient.ZkClient: zookeeper state changed (Disconnected)
17/11/16 12:23:23 INFO zkclient.ZkClient: zookeeper state changed (Disconnected)
17/11/16 12:23:24 INFO zkclient.ZkClient: zookeeper state changed (SyncConnected)
17/11/16 12:23:24 INFO zkclient.ZkClient: zookeeper state changed (SyncConnected)
17/11/16 12:23:24 INFO zkclient.ZkClient: zookeeper state changed (SyncConnected)
New Contributor
Posts: 1
Registered: ‎03-30-2018

Re: Timeout Error When Using kafka-console-consumer and kafka-console-producer On Secured Cluster

Hi Team,

 

I am getting below kafka exceptions in log, can anyone help me why we are getting below exceptions?

30 08:10:51.052 [Thread-13] org.apache.kafka.common.KafkaException: Failed to construct kafka producer

30 04:48:04.035 [Thread-1] org.apache.kafka.common.KafkaException: Failed to construct kafka consumer

 

Thank you all your help:

Cloudera Employee
Posts: 228
Registered: ‎01-09-2014

Re: Timeout Error When Using kafka-console-consumer and kafka-console-producer On Secured Cluster

There isn't enough information here to determine what the problem could be. If you can provide more log entries and your configuration, that may help.

-pd
Announcements