In One of Kafka node's one Disk Space got full

[#1]

Dears,

one of my kafka node's one of the disk is got full. Could you please suggest steps to make sure the 4 disks of my kafka node get sync in terms of disk occupancy.

Ref Snapshot is below

Swift response are highly appreciated

[#2 · Accepted solution]

Hi @DA-Ka 

Please check this official documentation:

• Reassigning replicas between log directories.
• kafka-reassign-partitions

Reassigning replicas between log directories can prove useful when you have multiple disks available, but one or more of them is nearing capacity.

[#3 · Accepted solution]

Hi @DA-Ka 

Please check this official documentation:

• Reassigning replicas between log directories.
• kafka-reassign-partitions

Reassigning replicas between log directories can prove useful when you have multiple disks available, but one or more of them is nearing capacity.

[#4 · Accepted solution]

Hello @DA-Ka 

The data might be skewed in one of the disks because some of the heavily used topics/partitions are in that particular disk. 

You may want to profile the data residing (sort the kafka logs.dir) and reassign them to the other disk using the partition reassignment tool kafka-reassign-partition.sh or manually. 

du -sh /kafka-logs/*