question Re: which time actaul block size assign ? Is it provide at spliting time in Mapper or after MapReduce flow? in Support Questions

which time actaul block size assign ? Is it provide at spliting time in Mapper or after MapReduce flow?

manish555111 — Mon, 24 Jul 2017 18:35:11 GMT

@Manish Gupta @Eric Hanson @Jay SenSharma

Re: which time actaul block size assign ? Is it provide at spliting time in Mapper or after MapReduce flow?

rbiswas1 — Wed, 26 Jul 2017 08:04:05 GMT

@Manish Kumar Yadav

You probably are looking at Hadoop block size vs split size.

Below is a nice read:

https://hadoopjournal.wordpress.com/2015/06/30/mapreduce-input-split-versus-hdfs-blocks/

Re: which time actaul block size assign ? Is it provide at spliting time in Mapper or after MapReduce flow?

manish555111 — Tue, 01 Aug 2017 01:42:43 GMT

@rbiswas yea Actually splitSize is equal to block size, so I want to know if we assign block size at SplitTime then job contains that memory for whole process or after reducer any changes;