Created 12-07-2018 08:33 AM
How to Reduce the data volume during shuffling between Mapper and Reducer Node ?
Created 12-07-2018 11:27 AM
Improve the performance of data transfer between Mapper and Reducer is by using the Combiner function. Combiner works as a mini reducer which operates on data generated by Mapper and used for the purpose of optimization.
2nd option is we can compress the intermediate output generated by Mapper with the below command in driver class
Created 12-09-2018 08:53 PM
Hello @Harshali Patel, did you see my answer here?
I hope this helps.