Reply
Highlighted
Explorer
Posts: 8
Registered: ‎06-14-2016

CDH 5.7 MapReduce is 30% slower than 4.7

Hello,

 

In the last week we migrated our old CDH 4.7 cluster to the new 5.7

 

I have noth cluster running at the moment.

 

What i notice, is that CDH 5.7 is 30% slower executing MR job compared to the CDH 4.7

 

Same code, same dataset, same number of mchines , same hardware

 

Setup on both clusters

10 Datanodes, 10 NodeManager instances

 

mapreduce.map.memory.mb=1278MB

mapreduce.reduce.memory.mb=2GB

mapreduce.map.cpu.vcores=1

 

 

Any tips how i can improve this ?

 

Announcements