Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

How to limit memory allocation for oozie mapreduce jobs

avatar
New Contributor

Hi all,

We are trying to schedule a sh using oozie. The problem is each oozie scheduler job takes 2 container and 13 gb allocated memory by default. We want to limit the allocated memory of the oozie mapreduce to 512 mb.

We tried adding oozie.launcher.mapreduce.map.memory.mb and oozie.launcher.yarn.app.mapreduce.am.resource.mb in workflow.xml -> <configuration>. But it did not help.

Any help to solve this is much appriciated.

1 REPLY 1

avatar
New Contributor

Yes, you can limit memory allocation for your oozie container by adding below properties in respective workflow.xml file....

 

<configuration>
<property>
<name>mapred.job.queue.name</name>
<value>${job_queue}</value>
</property>
<property>
<name>oozie.launcher.override</name>
<value>true</value>
</property>
<property>
<name>oozie.launcher.mapreduce.map.memory.mb</name>
<value>512</value>
</property>
<property>
<name>oozie.launcher.yarn.app.mapreduce.am.resource.mb</name>
<value>512</value>
</property>

</configuration>