we have HDP version 2.6.5
from confluent document we see that kafka maybe should works with RAID10 (https://docs.confluent.io/current/kafka/deployment.html )
but we configured the Kafka servers with multiple log directories, each directory mounted on a separate drive.
and we not have any RAID configuration ( mirrors disks )
now - lets assume we have 12 disks in the JBOD
so my question is :
in case one or two disks in kafka machine will fails
what is the affected on kafka machine with this situation ( dose kafka will loose data )?
Hi Michael Bronson
To answer your question; JBOD is not recommended!
Kafka Broker will crash and stop if any disk is corrupted or any I/O Error is encountered.
Your re-assignment of data (or replicas) won't work between disks in a single broker if you want to balance the data.