Skip to main content
DA-Ka
DA-Ka
Bronze III
October 3, 2021
Solved

In One of Kafka node's one Disk Space got full

Dears,

one of my kafka node's one of the disk is got full. Could you please suggest steps to make sure the 4 disks of my kafka node get sync in terms of disk occupancy.

Ref Snapshot is below

DA-Ka_0-1633246563397.png

 

Swift response are highly appreciated

 

Nandinin
NandininAnswer
Gold ⭐️
October 4, 2021

Hello @DA-Ka 

 

The data might be skewed in one of the disks because some of the heavily used topics/partitions are in that particular disk. 

 

You may want to profile the data residing (sort the kafka logs.dir) and reassign them to the other disk using the partition reassignment tool kafka-reassign-partition.sh or manually. 

 

 

du -sh /kafka-logs/*

 

 

 

SME || Kafka | Schema Registry | SMM | SRM
View in thread

2 replies

ShounenG
Gold ⭐️
ShounenG
Gold ⭐️
October 4, 2021

Hi @DA-Ka 

Please check this official documentation:

Reassigning replicas between log directories can prove useful when you have multiple disks available, but one or more of them is nearing capacity.

 

 

Translate
    Nandinin
    Gold ⭐️
    NandininAnswer
    Gold ⭐️
    October 4, 2021

    Hello @DA-Ka 

     

    The data might be skewed in one of the disks because some of the heavily used topics/partitions are in that particular disk. 

     

    You may want to profile the data residing (sort the kafka logs.dir) and reassign them to the other disk using the partition reassignment tool kafka-reassign-partition.sh or manually. 

     

     

    du -sh /kafka-logs/*

     

     

     

    Translate
    SME || Kafka | Schema Registry | SMM | SRM
    Terms & ConditionsAccessibility statement