Support Questions
Find answers, ask questions, and share your expertise

In One of Kafka node's one Disk Space got full

New Contributor

Dears,

one of my kafka node's one of the disk is got full. Could you please suggest steps to make sure the 4 disks of my kafka node get sync in terms of disk occupancy.

Ref Snapshot is below

DA-Ka_0-1633246563397.png

 

Swift response are highly appreciated

 

2 ACCEPTED SOLUTIONS

Cloudera Employee

Hi @DA-Ka 

Please check this official documentation:

Reassigning replicas between log directories can prove useful when you have multiple disks available, but one or more of them is nearing capacity.

 

 

View solution in original post

Contributor

Hello @DA-Ka 

 

The data might be skewed in one of the disks because some of the heavily used topics/partitions are in that particular disk. 

 

You may want to profile the data residing (sort the kafka logs.dir) and reassign them to the other disk using the partition reassignment tool kafka-reassign-partition.sh or manually. 

 

 

du -sh /kafka-logs/*

 

 

 

SME || Kafka | Schema Registry | SMM | SRM

View solution in original post

2 REPLIES 2

Cloudera Employee

Hi @DA-Ka 

Please check this official documentation:

Reassigning replicas between log directories can prove useful when you have multiple disks available, but one or more of them is nearing capacity.

 

 

Contributor

Hello @DA-Ka 

 

The data might be skewed in one of the disks because some of the heavily used topics/partitions are in that particular disk. 

 

You may want to profile the data residing (sort the kafka logs.dir) and reassign them to the other disk using the partition reassignment tool kafka-reassign-partition.sh or manually. 

 

 

du -sh /kafka-logs/*

 

 

 

SME || Kafka | Schema Registry | SMM | SRM
; ;