Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

One of the Kafka node slow

Highlighted

One of the Kafka node slow

New Contributor

Hi there,

We have a dev cluster with 3 nodes and we have installed Kafka on them. However during ingestion from Mysql binlog, we notice that 2 of the nodes are a slower, between the 2 nodes, one node has the lowest byte out to consumer. We can see that in the grafana graph.

The specs of the servers are as follow:

master nodeslave node1slave node2
20cores cpu,
140GB memory
900GB RAID 5 HDD
12 cores cpu,
94GB memory
900GB RAID0 HDD
12 cores cpu,

94GB memory
900GB RAID0 HDD

No matter how many partitions we set, the slave node2 will always be the slowest, I also notice there are some bad sector in the harddisk of slave node2, will it affect the speed of Kafka?

Hope someone with experience can shed some lights on this.

Thanks!

Don't have an account?
Coming from Hortonworks? Activate your account here