Support Questions

Find answers, ask questions, and share your expertise

How to limit memory allocation for oozie mapreduce jobs

avatar
New Contributor

Hi all,

We are trying to schedule a sh using oozie. The problem is each oozie scheduler job takes 2 container and 13 gb allocated memory by default. We want to limit the allocated memory of the oozie mapreduce to 512 mb.

We tried adding oozie.launcher.mapreduce.map.memory.mb and oozie.launcher.yarn.app.mapreduce.am.resource.mb in workflow.xml -> <configuration>. But it did not help.

Any help to solve this is much appriciated.

1 REPLY 1

avatar
New Contributor

Yes, you can limit memory allocation for your oozie container by adding below properties in respective workflow.xml file....

 

<configuration>
<property>
<name>mapred.job.queue.name</name>
<value>${job_queue}</value>
</property>
<property>
<name>oozie.launcher.override</name>
<value>true</value>
</property>
<property>
<name>oozie.launcher.mapreduce.map.memory.mb</name>
<value>512</value>
</property>
<property>
<name>oozie.launcher.yarn.app.mapreduce.am.resource.mb</name>
<value>512</value>
</property>

</configuration>