Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

In One of Kafka node's one Disk Space got full

avatar
New Contributor

Dears,

one of my kafka node's one of the disk is got full. Could you please suggest steps to make sure the 4 disks of my kafka node get sync in terms of disk occupancy.

Ref Snapshot is below

DA-Ka_0-1633246563397.png

 

Swift response are highly appreciated

 

2 ACCEPTED SOLUTIONS

avatar
Contributor

Hi @DA-Ka 

Please check this official documentation:

Reassigning replicas between log directories can prove useful when you have multiple disks available, but one or more of them is nearing capacity.

 

 

View solution in original post

avatar
Expert Contributor

Hello @DA-Ka 

 

The data might be skewed in one of the disks because some of the heavily used topics/partitions are in that particular disk. 

 

You may want to profile the data residing (sort the kafka logs.dir) and reassign them to the other disk using the partition reassignment tool kafka-reassign-partition.sh or manually. 

 

 

du -sh /kafka-logs/*

 

 

 

SME || Kafka | Schema Registry | SMM | SRM

View solution in original post

2 REPLIES 2

avatar
Contributor

Hi @DA-Ka 

Please check this official documentation:

Reassigning replicas between log directories can prove useful when you have multiple disks available, but one or more of them is nearing capacity.

 

 

avatar
Expert Contributor

Hello @DA-Ka 

 

The data might be skewed in one of the disks because some of the heavily used topics/partitions are in that particular disk. 

 

You may want to profile the data residing (sort the kafka logs.dir) and reassign them to the other disk using the partition reassignment tool kafka-reassign-partition.sh or manually. 

 

 

du -sh /kafka-logs/*

 

 

 

SME || Kafka | Schema Registry | SMM | SRM