Options
- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
what is mapreduce.task.io.sort.mb relate to?
Labels:
- Labels:
-
Apache Hadoop
-
Apache YARN
Explorer
Created ‎07-14-2017 08:41 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
map.memory = 2G map.opt=2048M io.sort.mb=2047M will cause ERROR JAVA HEAP SIZE
map.memory = 2G map.opt=3096M io.sort.mb=2047M is fine;
why?
1 REPLY 1
Super Collaborator
Created ‎08-18-2017 07:34 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
What do you have following property set to "yarn.scheduler.minimum-allocation-mb". when you set map.memory = 2G, you might end up getting a 4GB container with opt 2048.
