- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Oozie sqoop job creation failing
- Labels:
-
Apache Oozie
-
Apache Sqoop
Created ‎02-04-2016 11:24 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Oozie client build version: 4.2.0.2.3.4.0-3485
I'm trying to run
oozie sqoop ...
from a node in my cluster. I'm using a job.properties file as my configuration file and I've attempted to write the file as XML:
<configuration> <property> <name>jobTracker</name> <value>ip-10-85-2-192.ec2.internal:8050</value> </property> <property> <name>nameNode</name> <value>hdfs://ip-10-85-2-205.ec2.internal:8020</value> </property> </configuration>
and also as a plain file:
jobTracker=ip-10-85-2-192.ec2.internal:8050 nameNode=hdfs://ip-10-85-2-205.ec2.internal:8020When running the following command:
oozie sqoop --auth SIMPLE -config ./job.properties -command import --connect jdbc:postgresql://db.mydb.com/dbname --table foo --username foobar --password-file /user/oozie/share/password
And it keeps failing with:
java.lang.RuntimeException: jobtracker is not specified in conf at org.apache.oozie.client.XOozieClient.validateHttpSubmitConf(XOozieClient.java:130) at org.apache.oozie.client.XOozieClient.submitSqoop(XOozieClient.java:257) at org.apache.oozie.cli.OozieCLI.sqoopCommand(OozieCLI.java:2132) at org.apache.oozie.cli.OozieCLI.processCommand(OozieCLI.java:697) at org.apache.oozie.cli.OozieCLI.run(OozieCLI.java:626) at org.apache.oozie.cli.OozieCLI.main(OozieCLI.java:225) jobtracker is not specified in confIt would seem that I have specified the jobTracker property. Am I not wriing the job.properties file correctly? I've called it both locally (local on the node) and in HDFS.
Created ‎02-05-2016 12:08 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
<action name="load"> <sqoop> <job-tracker>${jobTracker}</job-tracker> <name-node>${nameNode}</name-node>
Created ‎02-04-2016 11:27 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Created ‎02-05-2016 12:08 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
<action name="load"> <sqoop> <job-tracker>${jobTracker}</job-tracker> <name-node>${nameNode}</name-node>
Created ‎02-24-2016 04:43 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
@J. David Can you confirm ?
Value of JobTracker property is value of yarn.resourcemanager.cluster-id in YARN settings in Ambari
