Created on 06-05-2018 05:57 PM - edited 09-16-2022 06:18 AM
Hello,
I got kafka version KAFKA-3.0.0-1.3.0.0.p0.40 running with 3 instances.
when I run with one kafka instance, I got the error:
Group coordinator one_kafka_hostname:9092 (id: 2147483391 rack: null) is unavailable or invalid, will attempt rediscovery
later, I made a change for advertised.host.name from default empty value to localhost, then run again, I got the following repated error with incremental correlation id:
[Producer clientId=producer-1] Error while fetching metadata with correlation id 362 : {ciovInput_v1=LEADER_NOT_AVAILABLE}
does anybody have any suggestions to reslove it?
many thanks for the help in advance.
Created 06-06-2018 01:40 PM
anybody knows where is the server.prperties configuration file for kafka?
I checked the file /opt/cloudera/parcels/KAFKA-3.0.0-1.3.0.0.p0.40/etc/kafka/conf.dist/
server.properties and noticed that its file timestamp is never changed even I changed advertised.host.name
from cloudera GUI for kafka. so it doesn't look like a valid configuration file for kafka in the running instance.
any suggestions? thanks
Created 06-08-2018 11:49 PM
Try connecting to zookeeper also could you share your commands . pls
Created 06-11-2018 09:57 AM
Here is the connection related to zookeeper, it looks that our created topic
ciovInput_v3 and ciovInput_v1 are there. thanks
# bin/kafka-topics.sh --describe --zookeeper localhost:2181
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/opt/cloudera/parcels/KAFKA-3.0.0-1.3.0.0.p0.40/lib/kafka/libs/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/cloudera/parcels/KAFKA-3.0.0-1.3.0.0.p0.40/lib/kafka/libs/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
Topic:__consumer_offsets PartitionCount:50 ReplicationFactor:3 Configs:segment.bytes=104857600,cleanup.policy=compact,compression.type=producer
Topic: __consumer_offsets Partition: 0 Leader: 256 Replicas: 256,257,255 Isr: 256
Topic: __consumer_offsets Partition: 1 Leader: 256 Replicas: 257,255,256 Isr: 256
Topic: __consumer_offsets Partition: 2 Leader: 256 Replicas: 255,256,257 Isr: 256
Topic: __consumer_offsets Partition: 3 Leader: 256 Replicas: 256,255,257 Isr: 256
Topic: __consumer_offsets Partition: 4 Leader: 256 Replicas: 257,256,255 Isr: 256
Topic: __consumer_offsets Partition: 5 Leader: 256 Replicas: 255,257,256 Isr: 256
Topic: __consumer_offsets Partition: 6 Leader: 256 Replicas: 256,257,255 Isr: 256
Topic: __consumer_offsets Partition: 7 Leader: 256 Replicas: 257,255,256 Isr: 256
Topic: __consumer_offsets Partition: 8 Leader: 256 Replicas: 255,256,257 Isr: 256
Topic: __consumer_offsets Partition: 9 Leader: 256 Replicas: 256,255,257 Isr: 256
Topic: __consumer_offsets Partition: 10 Leader: 256 Replicas: 257,256,255 Isr: 256
Topic: __consumer_offsets Partition: 11 Leader: 256 Replicas: 255,257,256 Isr: 256
Topic: __consumer_offsets Partition: 12 Leader: 256 Replicas: 256,257,255 Isr: 256
Topic: __consumer_offsets Partition: 13 Leader: 256 Replicas: 257,255,256 Isr: 256
Topic: __consumer_offsets Partition: 14 Leader: 256 Replicas: 255,256,257 Isr: 256
Topic: __consumer_offsets Partition: 15 Leader: 256 Replicas: 256,255,257 Isr: 256
Topic: __consumer_offsets Partition: 16 Leader: 256 Replicas: 257,256,255 Isr: 256
Topic: __consumer_offsets Partition: 17 Leader: 256 Replicas: 255,257,256 Isr: 256
Topic: __consumer_offsets Partition: 18 Leader: 256 Replicas: 256,257,255 Isr: 256
Topic: __consumer_offsets Partition: 19 Leader: 256 Replicas: 257,255,256 Isr: 256
Topic: __consumer_offsets Partition: 20 Leader: 256 Replicas: 255,256,257 Isr: 256
Topic: __consumer_offsets Partition: 21 Leader: 256 Replicas: 256,255,257 Isr: 256
Topic: __consumer_offsets Partition: 22 Leader: 256 Replicas: 257,256,255 Isr: 256
Topic: __consumer_offsets Partition: 23 Leader: 256 Replicas: 255,257,256 Isr: 256
Topic: __consumer_offsets Partition: 24 Leader: 256 Replicas: 256,257,255 Isr: 256
Topic: __consumer_offsets Partition: 25 Leader: 256 Replicas: 257,255,256 Isr: 256
Topic: __consumer_offsets Partition: 26 Leader: 256 Replicas: 255,256,257 Isr: 256
Topic: __consumer_offsets Partition: 27 Leader: 256 Replicas: 256,255,257 Isr: 256
Topic: __consumer_offsets Partition: 28 Leader: 256 Replicas: 257,256,255 Isr: 256
Topic: __consumer_offsets Partition: 29 Leader: 256 Replicas: 255,257,256 Isr: 256
Topic: __consumer_offsets Partition: 30 Leader: 256 Replicas: 256,257,255 Isr: 256
Topic: __consumer_offsets Partition: 31 Leader: 256 Replicas: 257,255,256 Isr: 256
Topic: __consumer_offsets Partition: 32 Leader: 256 Replicas: 255,256,257 Isr: 256
Topic: __consumer_offsets Partition: 33 Leader: 256 Replicas: 256,255,257 Isr: 256
Topic: __consumer_offsets Partition: 34 Leader: 256 Replicas: 257,256,255 Isr: 256
Topic: __consumer_offsets Partition: 35 Leader: 256 Replicas: 255,257,256 Isr: 256
Topic: __consumer_offsets Partition: 36 Leader: 256 Replicas: 256,257,255 Isr: 256
Topic: __consumer_offsets Partition: 37 Leader: 256 Replicas: 257,255,256 Isr: 256
Topic: __consumer_offsets Partition: 38 Leader: 256 Replicas: 255,256,257 Isr: 256
Topic: __consumer_offsets Partition: 39 Leader: 256 Replicas: 256,255,257 Isr: 256
Topic: __consumer_offsets Partition: 40 Leader: 256 Replicas: 257,256,255 Isr: 256
Topic: __consumer_offsets Partition: 41 Leader: 256 Replicas: 255,257,256 Isr: 256
Topic: __consumer_offsets Partition: 42 Leader: 256 Replicas: 256,257,255 Isr: 256
Topic: __consumer_offsets Partition: 43 Leader: 256 Replicas: 257,255,256 Isr: 256
Topic: __consumer_offsets Partition: 44 Leader: 256 Replicas: 255,256,257 Isr: 256
Topic: __consumer_offsets Partition: 45 Leader: 256 Replicas: 256,255,257 Isr: 256
Topic: __consumer_offsets Partition: 46 Leader: 256 Replicas: 257,256,255 Isr: 256
Topic: __consumer_offsets Partition: 47 Leader: 256 Replicas: 255,257,256 Isr: 256
Topic: __consumer_offsets Partition: 48 Leader: 256 Replicas: 256,257,255 Isr: 256
Topic: __consumer_offsets Partition: 49 Leader: 256 Replicas: 257,255,256 Isr: 256
Topic:ciovGSInput PartitionCount:1 ReplicationFactor:3 Configs:
Topic: ciovGSInput Partition: 0 Leader: 256 Replicas: 257,255,256 Isr: 256
Topic:ciovInput PartitionCount:1 ReplicationFactor:1 Configs:
Topic: ciovInput Partition: 0 Leader: 256 Replicas: 256 Isr: 256
Topic:ciovInput_v1 PartitionCount:1 ReplicationFactor:1 Configs:
Topic: ciovInput_v1 Partition: 0 Leader: 256 Replicas: 256 Isr: 256
Topic:ciovInput_v3 PartitionCount:1 ReplicationFactor:1 Configs:
Topic: ciovInput_v3 Partition: 0 Leader: 255 Replicas: 255 Isr: 255