- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
getting following messages in the kafka logs, is this related to data loss org.apache.kafka.common.errors.NotEnoughReplicasException: Number of insync replicas for partition [__consumer_offsets,18] is [1], below required minimum [3]
- Labels:
-
Apache Kafka
Created ‎12-13-2016 12:17 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Created ‎12-13-2016 12:28 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
The error indicates that your replication is falling behind,this exception doesn't really imply that a broker is down, it can likewise mean that an excessive number of copies for that topic partition have fallen behind the leader with some reason.
Created ‎12-13-2016 12:28 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
The error indicates that your replication is falling behind,this exception doesn't really imply that a broker is down, it can likewise mean that an excessive number of copies for that topic partition have fallen behind the leader with some reason.
Created ‎12-13-2016 01:17 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Configure your replication higher https://cwiki.apache.org/confluence/display/KAFKA/Replication+tools
You probably need more replicas for faster throughput
https://www.confluent.io/blog/how-to-choose-the-number-of-topicspartitions-in-a-kafka-cluster/
