Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

which time actaul block size assign ? Is it provide at spliting time in Mapper or after MapReduce flow?

Solved Go to solution
Highlighted

which time actaul block size assign ? Is it provide at spliting time in Mapper or after MapReduce flow?

@Manish Gupta @Eric Hanson @Jay SenSharma
1 ACCEPTED SOLUTION

Accepted Solutions

Re: which time actaul block size assign ? Is it provide at spliting time in Mapper or after MapReduce flow?

@Manish Kumar Yadav

You probably are looking at Hadoop block size vs split size.

Below is a nice read:

https://hadoopjournal.wordpress.com/2015/06/30/mapreduce-input-split-versus-hdfs-blocks/

2 REPLIES 2

Re: which time actaul block size assign ? Is it provide at spliting time in Mapper or after MapReduce flow?

@Manish Kumar Yadav

You probably are looking at Hadoop block size vs split size.

Below is a nice read:

https://hadoopjournal.wordpress.com/2015/06/30/mapreduce-input-split-versus-hdfs-blocks/

Re: which time actaul block size assign ? Is it provide at spliting time in Mapper or after MapReduce flow?

@rbiswas yea Actually splitSize is equal to block size, so I want to know if we assign block size at SplitTime then job contains that memory for whole process or after reducer any changes;

Don't have an account?
Coming from Hortonworks? Activate your account here