Support Questions

Find answers, ask questions, and share your expertise
Announcements
Now Live: Explore expert insights and technical deep dives on the new Cloudera Community BlogsRead the Announcement

How to limit memory allocation for oozie mapreduce jobs

avatar

Hi all,

We are trying to schedule a sh using oozie. The problem is each oozie scheduler job takes 2 container and 13 gb allocated memory by default. We want to limit the allocated memory of the oozie mapreduce to 512 mb.

We tried adding oozie.launcher.mapreduce.map.memory.mb and oozie.launcher.yarn.app.mapreduce.am.resource.mb in workflow.xml -> <configuration>. But it did not help.

Any help to solve this is much appriciated.

1 REPLY 1

avatar
New Member

Yes, you can limit memory allocation for your oozie container by adding below properties in respective workflow.xml file....

 

<configuration>
<property>
<name>mapred.job.queue.name</name>
<value>${job_queue}</value>
</property>
<property>
<name>oozie.launcher.override</name>
<value>true</value>
</property>
<property>
<name>oozie.launcher.mapreduce.map.memory.mb</name>
<value>512</value>
</property>
<property>
<name>oozie.launcher.yarn.app.mapreduce.am.resource.mb</name>
<value>512</value>
</property>

</configuration>