- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
How to limit memory allocation for oozie mapreduce jobs
- Labels:
-
Apache Oozie
Created ‎10-09-2017 07:48 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi all,
We are trying to schedule a sh using oozie. The problem is each oozie scheduler job takes 2 container and 13 gb allocated memory by default. We want to limit the allocated memory of the oozie mapreduce to 512 mb.
We tried adding oozie.launcher.mapreduce.map.memory.mb and oozie.launcher.yarn.app.mapreduce.am.resource.mb in workflow.xml -> <configuration>. But it did not help.
Any help to solve this is much appriciated.
Created ‎09-16-2020 07:29 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Yes, you can limit memory allocation for your oozie container by adding below properties in respective workflow.xml file....
<configuration>
<property>
<name>mapred.job.queue.name</name>
<value>${job_queue}</value>
</property>
<property>
<name>oozie.launcher.override</name>
<value>true</value>
</property>
<property>
<name>oozie.launcher.mapreduce.map.memory.mb</name>
<value>512</value>
</property>
<property>
<name>oozie.launcher.yarn.app.mapreduce.am.resource.mb</name>
<value>512</value>
</property>
</configuration>
