Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Mix Datanode Disk Size

Mix Datanode Disk Size

New Contributor

Hello , 

 

at the moment i reinstall all Datanodes of one Cluster with new OS. 

So we has 9 Datnodes. 

 

4 Datanodes with 8 TB * 12 Disks 

2 Datanodes with 4TB * 24 Disks

2 Datanodes with 6 TB * 12 Disks 

 

So should we Partion  the 8 TB Disks to 4 TB * 24 DiskPartions ? 
Or should we leave it as it is ? 

 

What is the best Solution ? 

rg

marcel 

1 REPLY 1
Highlighted

Re: Mix Datanode Disk Size

Expert Contributor

Hi @wernermarcel ,

 

You need at least 3 data nodes to give you fault tolerance in your architecture as HDFS triple replicates the data across the infrastructure. Using more and smaller disks will give you better throughput and better performance.

 

Here is a recent Cloudera blog that I recommend for you:

 

Disk and Datanode Size in HDFS

 

Regards,

Steve

Don't have an account?
Coming from Hortonworks? Activate your account here