Support Questions
Find answers, ask questions, and share your expertise

What is the difference between Partitioner, Combiner, Shuffle and sort phase in Map Reduce. What is the order of execution

Solved Go to solution

Re: What is the difference between Partitioner, Combiner, Shuffle and sort phase in Map Reduce. What is the order of execution

May I ask why you care? Any specific curiosity or performance problem or just curiosity?

Highlighted

Re: What is the difference between Partitioner, Combiner, Shuffle and sort phase in Map Reduce. What is the order of execution

Explorer

@ Benjamin Leonhardi Why sorting is written before shuffling? I think sorting always happen after the shuffling. As there is already combiner to combine(sort) the output on single node. I think when all intermediated data collected using shuffling then sorting is use to make one single input file, which will use by reducer.