Member since
01-27-2016
14
Posts
10
Kudos Received
3
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 2638 | 07-06-2017 10:02 AM | |
| 7563 | 01-17-2017 05:34 AM | |
| 2699 | 08-30-2016 11:48 AM |
01-17-2017
05:58 AM
4 Kudos
When using the Oozie Proxy job submission API for submitting the Oozie Hive, Sqoop and Pig actions. To pass any configuration to the action is required to be in below format. For Hive action: oozie.hive.options.size
: The number of options you'll be passing to Pig oozie.hive.options.n
: An argument to pass to Hive, the 'n' should be an integer starting with 0 to indicate the option number <property>
<name>oozie.hive.options.1</name>
<value>-Doozie.launcher.mapreduce.job.queuename=hive</value>
</property>
<property>
<name>oozie.hive.options.0</name>
<value>-Dmapreduce.job.queuename=hive</value>
</property>
<property>
<name>oozie.hive.options.size</name>
<value>2</value>
</property> For Pig Action:
oozie.pig.options.size
: The number of options you'll be passing to Pig oozie.pig.options.n
: An argument to pass to Pig, the 'n' should be an integer starting with 0 to indicate the option number <property>
<name>oozie.pig.options.1</name>
<value>-Doozie.launcher.mapreduce.job.queuename=pig</value>
</property>
<property>
<name>oozie.pig.options.0</name>
<value>-Dmapreduce.job.queuename=pig</value>
</property>
<property>
<name>oozie.pig.options.size</name>
<value>2</value>
</property> For Sqoop Action: oozie.sqoop.options.size
: The number of options you'll be passing to Sqoop Hadoop job oozie.sqoop.options.n
: An argument to pass to Sqoop hadoop job conf, the 'n' should be an integer starting with zero(0) to indicate the option number <property>
<name>oozie.sqoop.options.1</name>
<value>-Doozie.launcher.mapreduce.job.queuename=sqoop</value>
</property>
<property>
<name>oozie.sqoop.options.0</name>
<value>-Dmapreduce.job.queuename=sqoop</value>
</property>
<property>
<name>oozie.sqoop.options.size</name>
<value>2</value>
</property>
... View more
Labels:
03-06-2017
06:50 AM
Simply set a propert in oozie workflow ie. hadoop property "MAPRED>JOB>QUEUENAME" value would be "YOUR_QUEUE_NAME". this worked for me my oozie workflow is being submitted to a particular QUEUE now. Cheers. , I also had the similar requirement to submit the job in a particular queue. We simply need to change at one place that is oozie workflow settings. Add one hadoop property there as "MAPRED.JOB.QUEUENAME" and Value is "YOUR_QUEUE_NAME". By this way workflow is submitted to defined queue.
... View more