Member since
01-13-2017
3
Posts
2
Kudos Received
0
Solutions
01-17-2017
02:01 PM
Abhishek, Thank you, this worked!
... View more
01-16-2017
01:48 PM
Thank you for your response! I added that parameter to the XML: <?xml version="1.0" encoding="UTF-8" standalone="yes"?>
<configuration>
<property>
<name>fs.default.name</name>
<value> ... removed ... </value>
</property>
<property>
<name>mapred.job.tracker</name>
<value> ... removed ... </value>
</property>
<property>
<name>oozie.launcher.mapreduce.job.queuename</name>
<value>sqoop</value>
</property>
<property>
<name>mapreduce.job.queuename</name>
<value>sqoop</value>
</property>
<property>
<name>user.name</name>
<value> ... removed ... </value>
</property>
<property>
<name>oozie.sqoop.command</name>
<value> ... removed ... </value>
</property>
<property>
<name>oozie.libpath</name>
<value> ... removed ... </value>
</property>
<property>
<name>oozie.proxysubmission</name>
<value>true</value>
</property>
</configuration>
And ran the application, but both jobs are still getting submitted to the default queue: It is as if the web service is ignoring these options.
... View more
01-13-2017
08:37 PM
2 Kudos
We
are trying to submit Oozie sqoop jobs using the Oozie Web Services API, sqoop
job proxy submission as documented here: https://oozie.apache.org/docs/4.1.0/WebServicesAPI.html#Proxy_Sqoop_Job_Submission We
are working with a kerberized cluster with Knox gateway, and have not been able
to find good documentation on how to implement the AuthOozieClient in an
environment like this. (If anyone has some documentation they could share
on this, that would be great!) The
sqoop command is generated dynamically based on selections made by the user in
a web interface, and the XML sent to Oozie. The jobs are going to the
“default” queue, and we want them to go to their own queue. I
have tried adding the following to the XML that is passed to the web service,
but the jobs are still being submitted to the default queue: <property>
<name>mapreduce.job.queuename</name>
<value>sqoop</value>
</property> Using
this property when running sqoop from the command line, or adding it to a
workflow.xml file in the configuration section, allows the jobs to be submitted
to the sqoop queue. Does
anyone know if this web service supports specifying properties other than the
required and optional properties documented? Is there a different way to
accomplish this while still using the sqoop job proxy submission? Thank
you for any help you can provide.
... View more
Labels:
- Labels:
-
Apache Oozie
-
Apache Sqoop