Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

How many combiners run in MapReduce?

How many combiners run in MapReduce?

New Contributor

How many combiners run in MapReduce?

1 REPLY 1
Highlighted

Re: How many combiners run in MapReduce?

Guru

@Pritam Pal , Combiner is used to summarize map output records with same key. This process reduces the data transfer across network between mapper and reducer.

Hadoop doesn’t guarantee on how many times a combiner function will be called for each map output key. At times, it may not be executed at all, while at times it may be used once, twice, or more times depending on the size and number of output files generated by the mapper for each reducer.

https://www.tutorialspoint.com/map_reduce/map_reduce_combiners.htm

Don't have an account?
Coming from Hortonworks? Activate your account here