Support Questions

Find answers, ask questions, and share your expertise

Oozie sqoop job creation failing

avatar

Oozie client build version: 4.2.0.2.3.4.0-3485

I'm trying to run oozie sqoop ... from a node in my cluster. I'm using a job.properties file as my configuration file and I've attempted to write the file as XML:

<configuration>
  <property>
    <name>jobTracker</name>
    <value>ip-10-85-2-192.ec2.internal:8050</value>
  </property>
  <property>
    <name>nameNode</name>
    <value>hdfs://ip-10-85-2-205.ec2.internal:8020</value>
  </property>
</configuration>

and also as a plain file:

jobTracker=ip-10-85-2-192.ec2.internal:8050
nameNode=hdfs://ip-10-85-2-205.ec2.internal:8020
When running the following command: oozie sqoop --auth SIMPLE -config ./job.properties -command import --connect jdbc:postgresql://db.mydb.com/dbname --table foo --username foobar --password-file /user/oozie/share/password And it keeps failing with:
java.lang.RuntimeException: jobtracker is not specified in conf
	at org.apache.oozie.client.XOozieClient.validateHttpSubmitConf(XOozieClient.java:130)
	at org.apache.oozie.client.XOozieClient.submitSqoop(XOozieClient.java:257)
	at org.apache.oozie.cli.OozieCLI.sqoopCommand(OozieCLI.java:2132)
	at org.apache.oozie.cli.OozieCLI.processCommand(OozieCLI.java:697)
	at org.apache.oozie.cli.OozieCLI.run(OozieCLI.java:626)
	at org.apache.oozie.cli.OozieCLI.main(OozieCLI.java:225)
jobtracker is not specified in conf
It would seem that I have specified the jobTracker property. Am I not wriing the job.properties file correctly? I've called it both locally (local on the node) and in HDFS.
1 ACCEPTED SOLUTION

avatar
Master Guru
<action name="load">
        <sqoop>
           <job-tracker>${jobTracker}</job-tracker>
            <name-node>${nameNode}</name-node>

View solution in original post

3 REPLIES 3

avatar
Master Mentor
@J. David

please copy my workflows if you'd like Link

avatar
Master Guru
<action name="load">
        <sqoop>
           <job-tracker>${jobTracker}</job-tracker>
            <name-node>${nameNode}</name-node>

avatar

@J. David Can you confirm ?

Value of JobTracker property is value of yarn.resourcemanager.cluster-id in YARN settings in Ambari