Reply
Explorer
Posts: 15
Registered: ‎04-11-2017

kafka running issue

Hello,

I got kafka version KAFKA-3.0.0-1.3.0.0.p0.40  running with 3 instances.

when I run with one kafka instance, I got the error:

 

Group coordinator one_kafka_hostname:9092 (id: 2147483391 rack: null) is unavailable or invalid, will attempt rediscovery

 

later, I made a change for advertised.host.name  from default empty value to localhost, then run again, I got the following repated error with incremental correlation id:
   

[Producer clientId=producer-1] Error while fetching metadata with correlation id 362 : {ciovInput_v1=LEADER_NOT_AVAILABLE}

 

does anybody have any suggestions to reslove it? 

 

many thanks for the help in advance.

 

Explorer
Posts: 15
Registered: ‎04-11-2017

Re: kafka running issue

 

anybody knows where is the server.prperties configuration file for kafka?

 

I checked the file /opt/cloudera/parcels/KAFKA-3.0.0-1.3.0.0.p0.40/etc/kafka/conf.dist/

server.properties  and noticed that its file timestamp is never changed even I changed advertised.host.name 

from cloudera GUI for kafka. so it doesn't look like a valid configuration file for kafka in the running instance.

 

any suggestions? thanks

Champion
Posts: 731
Registered: ‎05-16-2016

Re: kafka running issue

Try connecting to zookeeper also could you share your commands . pls 

Highlighted
Explorer
Posts: 15
Registered: ‎04-11-2017

Re: kafka running issue

Here is the connection related to zookeeper, it looks that our created topic

ciovInput_v3 and ciovInput_v1 are there. thanks

 

# bin/kafka-topics.sh --describe --zookeeper localhost:2181

SLF4J: Class path contains multiple SLF4J bindings.

SLF4J: Found binding in [jar:file:/opt/cloudera/parcels/KAFKA-3.0.0-1.3.0.0.p0.40/lib/kafka/libs/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]

SLF4J: Found binding in [jar:file:/opt/cloudera/parcels/KAFKA-3.0.0-1.3.0.0.p0.40/lib/kafka/libs/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]

SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.

SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]

Topic:__consumer_offsets PartitionCount:50 ReplicationFactor:3 Configs:segment.bytes=104857600,cleanup.policy=compact,compression.type=producer

Topic: __consumer_offsets Partition: 0 Leader: 256 Replicas: 256,257,255 Isr: 256

Topic: __consumer_offsets Partition: 1 Leader: 256 Replicas: 257,255,256 Isr: 256

Topic: __consumer_offsets Partition: 2 Leader: 256 Replicas: 255,256,257 Isr: 256

Topic: __consumer_offsets Partition: 3 Leader: 256 Replicas: 256,255,257 Isr: 256

Topic: __consumer_offsets Partition: 4 Leader: 256 Replicas: 257,256,255 Isr: 256

Topic: __consumer_offsets Partition: 5 Leader: 256 Replicas: 255,257,256 Isr: 256

Topic: __consumer_offsets Partition: 6 Leader: 256 Replicas: 256,257,255 Isr: 256

Topic: __consumer_offsets Partition: 7 Leader: 256 Replicas: 257,255,256 Isr: 256

Topic: __consumer_offsets Partition: 8 Leader: 256 Replicas: 255,256,257 Isr: 256

Topic: __consumer_offsets Partition: 9 Leader: 256 Replicas: 256,255,257 Isr: 256

Topic: __consumer_offsets Partition: 10 Leader: 256 Replicas: 257,256,255 Isr: 256

Topic: __consumer_offsets Partition: 11 Leader: 256 Replicas: 255,257,256 Isr: 256

Topic: __consumer_offsets Partition: 12 Leader: 256 Replicas: 256,257,255 Isr: 256

Topic: __consumer_offsets Partition: 13 Leader: 256 Replicas: 257,255,256 Isr: 256

Topic: __consumer_offsets Partition: 14 Leader: 256 Replicas: 255,256,257 Isr: 256

Topic: __consumer_offsets Partition: 15 Leader: 256 Replicas: 256,255,257 Isr: 256

Topic: __consumer_offsets Partition: 16 Leader: 256 Replicas: 257,256,255 Isr: 256

Topic: __consumer_offsets Partition: 17 Leader: 256 Replicas: 255,257,256 Isr: 256

Topic: __consumer_offsets Partition: 18 Leader: 256 Replicas: 256,257,255 Isr: 256

Topic: __consumer_offsets Partition: 19 Leader: 256 Replicas: 257,255,256 Isr: 256

Topic: __consumer_offsets Partition: 20 Leader: 256 Replicas: 255,256,257 Isr: 256

Topic: __consumer_offsets Partition: 21 Leader: 256 Replicas: 256,255,257 Isr: 256

Topic: __consumer_offsets Partition: 22 Leader: 256 Replicas: 257,256,255 Isr: 256

Topic: __consumer_offsets Partition: 23 Leader: 256 Replicas: 255,257,256 Isr: 256

Topic: __consumer_offsets Partition: 24 Leader: 256 Replicas: 256,257,255 Isr: 256

Topic: __consumer_offsets Partition: 25 Leader: 256 Replicas: 257,255,256 Isr: 256

Topic: __consumer_offsets Partition: 26 Leader: 256 Replicas: 255,256,257 Isr: 256

Topic: __consumer_offsets Partition: 27 Leader: 256 Replicas: 256,255,257 Isr: 256

Topic: __consumer_offsets Partition: 28 Leader: 256 Replicas: 257,256,255 Isr: 256

Topic: __consumer_offsets Partition: 29 Leader: 256 Replicas: 255,257,256 Isr: 256

Topic: __consumer_offsets Partition: 30 Leader: 256 Replicas: 256,257,255 Isr: 256

Topic: __consumer_offsets Partition: 31 Leader: 256 Replicas: 257,255,256 Isr: 256

Topic: __consumer_offsets Partition: 32 Leader: 256 Replicas: 255,256,257 Isr: 256

Topic: __consumer_offsets Partition: 33 Leader: 256 Replicas: 256,255,257 Isr: 256

Topic: __consumer_offsets Partition: 34 Leader: 256 Replicas: 257,256,255 Isr: 256

Topic: __consumer_offsets Partition: 35 Leader: 256 Replicas: 255,257,256 Isr: 256

Topic: __consumer_offsets Partition: 36 Leader: 256 Replicas: 256,257,255 Isr: 256

Topic: __consumer_offsets Partition: 37 Leader: 256 Replicas: 257,255,256 Isr: 256

Topic: __consumer_offsets Partition: 38 Leader: 256 Replicas: 255,256,257 Isr: 256

Topic: __consumer_offsets Partition: 39 Leader: 256 Replicas: 256,255,257 Isr: 256

Topic: __consumer_offsets Partition: 40 Leader: 256 Replicas: 257,256,255 Isr: 256

Topic: __consumer_offsets Partition: 41 Leader: 256 Replicas: 255,257,256 Isr: 256

Topic: __consumer_offsets Partition: 42 Leader: 256 Replicas: 256,257,255 Isr: 256

Topic: __consumer_offsets Partition: 43 Leader: 256 Replicas: 257,255,256 Isr: 256

Topic: __consumer_offsets Partition: 44 Leader: 256 Replicas: 255,256,257 Isr: 256

Topic: __consumer_offsets Partition: 45 Leader: 256 Replicas: 256,255,257 Isr: 256

Topic: __consumer_offsets Partition: 46 Leader: 256 Replicas: 257,256,255 Isr: 256

Topic: __consumer_offsets Partition: 47 Leader: 256 Replicas: 255,257,256 Isr: 256

Topic: __consumer_offsets Partition: 48 Leader: 256 Replicas: 256,257,255 Isr: 256

Topic: __consumer_offsets Partition: 49 Leader: 256 Replicas: 257,255,256 Isr: 256

Topic:ciovGSInput PartitionCount:1 ReplicationFactor:3 Configs:

Topic: ciovGSInput Partition: 0 Leader: 256 Replicas: 257,255,256 Isr: 256

Topic:ciovInput PartitionCount:1 ReplicationFactor:1 Configs:

Topic: ciovInput Partition: 0 Leader: 256 Replicas: 256 Isr: 256

Topic:ciovInput_v1 PartitionCount:1 ReplicationFactor:1 Configs:

Topic: ciovInput_v1 Partition: 0 Leader: 256 Replicas: 256 Isr: 256

Topic:ciovInput_v3 PartitionCount:1 ReplicationFactor:1 Configs:

Topic: ciovInput_v3 Partition: 0 Leader: 255 Replicas: 255 Isr: 255

 

Announcements