Support Questions
Find answers, ask questions, and share your expertise

HDFS block storage clarification

Solved Go to solution
Highlighted

HDFS block storage clarification

Contributor

If a file of size 10 MB is copied on to HDFS of block size 256 MB, then how much storage will be allocated to the file on HDFS ? Let us assume replication factor is 3 so it will occupy (256 MB)*3 on HDFS.Please correct me if i am wrong?

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted

Re: HDFS block storage clarification

no it will occupy 3*10 = 30M on hdfs,HDFS capacity is consumed based on the actual file size but a block is consumed per file

View solution in original post

3 REPLIES 3
Highlighted

Re: HDFS block storage clarification

no it will occupy 3*10 = 30M on hdfs,HDFS capacity is consumed based on the actual file size but a block is consumed per file

View solution in original post

Re: HDFS block storage clarification

Contributor

ok.In that case 768(256*3)-30=738MB is used for other files or is it waste of memory?

Highlighted

Re: HDFS block storage clarification

@vamsi valiveti rest of the memory is used by other files.

Don't have an account?