- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Difference between spaceConsumed vs length parameters in getContentSummary using webHDFS REST API
- Labels:
-
Apache Hadoop
Created ‎08-19-2016 07:06 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
According to the following doc, spaceConsumed refers to the "The disk space consumed by the content." and length refers to "The number of bytes used by the content."
https://hadoop.apache.org/docs/r1.0.4/webhdfs.html#ContentSummary
What would be the real difference here in terms of space taken from HDFS?
Consider that most of time, if not always, spaceConsumed has a lot larger value then length. What does spaceConsumed consider that length does not?
Created ‎08-19-2016 08:14 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
spaceConsumed = length * replicationFactor
Created ‎08-19-2016 08:14 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
spaceConsumed = length * replicationFactor
