Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

what is mapreduce.task.io.sort.mb relate to?

Highlighted

what is mapreduce.task.io.sort.mb relate to?

New Contributor

map.memory = 2G map.opt=2048M io.sort.mb=2047M will cause ERROR JAVA HEAP SIZE

map.memory = 2G map.opt=3096M io.sort.mb=2047M is fine;

why?

1 REPLY 1

Re: what is mapreduce.task.io.sort.mb relate to?

Expert Contributor

What do you have following property set to "yarn.scheduler.minimum-allocation-mb". when you set map.memory = 2G, you might end up getting a 4GB container with opt 2048.