Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

How to calculate space quota for erasure coded directory?

Solved Go to solution
Highlighted

How to calculate space quota for erasure coded directory?

 
1 ACCEPTED SOLUTION

Accepted Solutions

Re: How to calculate space quota for erasure coded directory?

The jira proposes 10+4 ( 10 data blocks with 4 additional blocks for the RAID ) which would be roughly 40% overhead. But I think I have seen 6+3 as well somewhere. In both cases you should be able to roughly count with 50% overhead. But as Neeraj says we will have to wait to see final figures.

https://issues.apache.org/jira/browse/HDFS-7285

3 REPLIES 3

Re: How to calculate space quota for erasure coded directory?

@ssathish This is a good question and I believe we need to wait for the final docs to come out with more information.

Apache Hadoop 3.0.0-SNAPSHOT link is shared in my reply

Re: How to calculate space quota for erasure coded directory?

The jira proposes 10+4 ( 10 data blocks with 4 additional blocks for the RAID ) which would be roughly 40% overhead. But I think I have seen 6+3 as well somewhere. In both cases you should be able to roughly count with 50% overhead. But as Neeraj says we will have to wait to see final figures.

https://issues.apache.org/jira/browse/HDFS-7285

Re: How to calculate space quota for erasure coded directory?

6+3 worked for me. Thanks!