- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
HDFS block storage clarification
- Labels:
-
Apache Hadoop
-
Cloudera DataFlow (CDF)
Created ‎11-15-2016 01:23 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
If a file of size 10 MB is copied on to HDFS of block size 256 MB, then how much storage will be allocated to the file on HDFS ? Let us assume replication factor is 3 so it will occupy (256 MB)*3 on HDFS.Please correct me if i am wrong?
Created ‎11-15-2016 01:30 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
no it will occupy 3*10 = 30M on hdfs,HDFS capacity is consumed based on the actual file size but a block is consumed per file
Created ‎11-15-2016 01:30 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
no it will occupy 3*10 = 30M on hdfs,HDFS capacity is consumed based on the actual file size but a block is consumed per file
Created ‎11-15-2016 02:01 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
ok.In that case 768(256*3)-30=738MB is used for other files or is it waste of memory?
Created ‎11-15-2016 03:27 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
@vamsi valiveti rest of the memory is used by other files.
