Oozie sqoop job creation failing

james_denman — Fri, 05 Feb 2016 07:24:02 GMT

Oozie client build version: 4.2.0.2.3.4.0-3485

I'm trying to run oozie sqoop ... from a node in my cluster. I'm using a job.properties file as my configuration file and I've attempted to write the file as XML:

<configuration>
  <property>
    <name>jobTracker</name>
    <value>ip-10-85-2-192.ec2.internal:8050</value>
  </property>
  <property>
    <name>nameNode</name>
    <value>hdfs://ip-10-85-2-205.ec2.internal:8020</value>
  </property>
</configuration>

and also as a plain file:

jobTracker=ip-10-85-2-192.ec2.internal:8050
nameNode=hdfs://ip-10-85-2-205.ec2.internal:8020

When running the following command:

oozie sqoop --auth SIMPLE -config ./job.properties -command import --connect jdbc:postgresql://db.mydb.com/dbname --table foo --username foobar --password-file /user/oozie/share/password

And it keeps failing with:

java.lang.RuntimeException: jobtracker is not specified in conf
	at org.apache.oozie.client.XOozieClient.validateHttpSubmitConf(XOozieClient.java:130)
	at org.apache.oozie.client.XOozieClient.submitSqoop(XOozieClient.java:257)
	at org.apache.oozie.cli.OozieCLI.sqoopCommand(OozieCLI.java:2132)
	at org.apache.oozie.cli.OozieCLI.processCommand(OozieCLI.java:697)
	at org.apache.oozie.cli.OozieCLI.run(OozieCLI.java:626)
	at org.apache.oozie.cli.OozieCLI.main(OozieCLI.java:225)
jobtracker is not specified in conf

It would seem that I have specified the jobTracker property. Am I not wriing the job.properties file correctly? I've called it both locally (local on the node) and in HDFS.

Re: Oozie sqoop job creation failing

aervits — Fri, 05 Feb 2016 07:27:46 GMT

@J. David

please copy my workflows if you'd like Link

Re: Oozie sqoop job creation failing

bleonhardi — Fri, 05 Feb 2016 08:08:19 GMT

<action name="load">
        <sqoop>
           <job-tracker>${jobTracker}</job-tracker>
            <name-node>${nameNode}</name-node>

Re: Oozie sqoop job creation failing

shishir_saxena4 — Thu, 25 Feb 2016 00:43:57 GMT

@J. David Can you confirm ?

Value of JobTracker property is value of yarn.resourcemanager.cluster-id in YARN settings in Ambari

question Oozie sqoop job creation failing in Archives of Support Questions (Read Only)

Oozie sqoop job creation failing

Re: Oozie sqoop job creation failing

Re: Oozie sqoop job creation failing

Re: Oozie sqoop job creation failing