- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
which time actaul block size assign ? Is it provide at spliting time in Mapper or after MapReduce flow?
- Labels:
-
Apache Hadoop
Created ‎07-24-2017 11:35 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Created ‎07-26-2017 01:04 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
You probably are looking at Hadoop block size vs split size.
Below is a nice read:
https://hadoopjournal.wordpress.com/2015/06/30/mapreduce-input-split-versus-hdfs-blocks/
Created ‎07-26-2017 01:04 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
You probably are looking at Hadoop block size vs split size.
Below is a nice read:
https://hadoopjournal.wordpress.com/2015/06/30/mapreduce-input-split-versus-hdfs-blocks/
Created ‎07-31-2017 06:42 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
@rbiswas yea Actually splitSize is equal to block size, so I want to know if we assign block size at SplitTime then job contains that memory for whole process or after reducer any changes;
