Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

what is mapreduce.task.io.sort.mb relate to?

what is mapreduce.task.io.sort.mb relate to?

Explorer

map.memory = 2G map.opt=2048M io.sort.mb=2047M will cause ERROR JAVA HEAP SIZE

map.memory = 2G map.opt=3096M io.sort.mb=2047M is fine;

why?

1 REPLY 1
Highlighted

Re: what is mapreduce.task.io.sort.mb relate to?

Expert Contributor

What do you have following property set to "yarn.scheduler.minimum-allocation-mb". when you set map.memory = 2G, you might end up getting a 4GB container with opt 2048.

Don't have an account?
Coming from Hortonworks? Activate your account here