Created 07-01-2019 05:05 AM
we have 5 kafka brokers in our kafka cluster
the state for now is on all topics names
and all topics are with negative number and Isr without brokers id
Topic: test1 Partition: 1 Leader: -1 Replicas: 1,2,3 Isr: Topic: test2 Partition: 1 Leader: -1 Replicas: 2,3,1 Isr: Topic: test3 Partition: 1 Leader: -1 Replicas: 3,2,1 Isr: Topic: test4 Partition: 1 Leader: -1 Replicas: 1,3,2 Isr: Topic: test5 Partition: 1 Leader: -1 Replicas: 2,1,3 Isr:
any common reason for this behavior ?
Created 07-01-2019 06:46 AM
The most probable explanation is one of your Kafka brokers is down. Please, could you check the active Kafka brokers?
$ ./zookeeper-shell.sh localhost:2181 <<< "ls /brokers/ids"
And the output should be similar to the one below:
Connecting to localhost:2181 Welcome to ZooKeeper! JLine support is enabled WATCHER:: WatchedEvent state:SyncConnected type:None path:null [zk: localhost:2181(CONNECTED) 0] ls /brokers/ids [0, 1, 2, 3, 4 ] [zk: localhost:2181(CONNECTED) 1]
If you get less than in the above investigate why that particular broker is down! What is your current replication factor? You should also check the offline partitions metric to confirm this, but also check whether all brokers are functioning normally.
I would also suggest increasing the replication-factor since you have a multi-broker configuration.
Created 07-01-2019 08:18 AM
@Geoffrey Shelton Okot all brokers are up always and replication factor is 3
Created 07-01-2019 08:24 AM
what you mean about - "also check the offline partitions metric to confirm this " ?
Created 07-02-2019 01:31 AM
The above question was originally posted in the Community Help track. On Tue Jul 2 01:01 UTC 2019, a member of the HCC moderation staff moved it to the Data Ingestion & Streaming track. The Community Help Track is intended for questions about using the HCC site itself, not technical questions about Kafka administration.