Reply
Highlighted
Explorer
Posts: 16
Registered: ‎05-01-2014

Scoop issue with Oozie

[ Edited ]

Hi,

I am trying to import data from teradata to hive using scoop through oozie. Oozie scoop action always fail with error stating that $SQOOP_CONF_DIR is not set.

Error :
2758 [main] WARN org.apache.sqoop.tool.SqoopTool – $SQOOP_CONF_DIR has not been set in the environment. Cannot check for additional configuration.
Intercepting System.exit(1)

Workflow.xml:
<action name=”generateoffersreport1″>
<sqoop xmlns=”uri:oozie:sqoop-action:0.2″>
<job-tracker>${jobTracker}</job-tracker>
<name-node>${nameNode}</name-node>
<configuration>
<property>
<name>mapreduce.job.queuename</name>
<value>${queueName}</value>
</property>

</configuration>
<command>${IMPORT_DIGLOFFR_COMMAND}</command>
<archive>${DEPENDENY_FILE_LOCATION}</archive>
</sqoop>

<ok to=”emailnotification”/>
<error to=”fail”/>
</action>

Shared Libraries inside Oozie:
hadoop fs -ls /user/oozie/share/lib/sqoop
Found 6 items
-rw-r–r– 3 oozie hdfs 163151 2014-10-30 13:47 /user/oozie/share/lib/sqoop/commons-io-2.1.jar
-rw-r–r– 3 oozie hdfs 706710 2014-10-30 13:47 /user/oozie/share/lib/sqoop/hsqldb-1.8.0.10.jar
-rw-r–r– 3 oozie hdfs 7890 2014-10-30 13:47 /user/oozie/share/lib/sqoop/oozie-sharelib-sqoop-4.0.0.2.1.2.0-402.jar
-rw-r–r– 3 oozie hdfs 819248 2014-10-30 13:47 /user/oozie/share/lib/sqoop/sqoop-1.4.4.2.1.2.0-402.jar
-rw-r–r– 3 daas hdfs 2405 2015-03-25 22:47 /user/oozie/share/lib/sqoop/tdgssconfig.jar
-rw-r–r– 3 daas hdfs 873860 2015-03-25 22:46 /user/oozie/share/lib/sqoop/terajdbc4.jar

I am not sure where the error is? could you please help on how to resolve it.

Thanks,
Asmath

Posts: 1,825
Kudos: 406
Solutions: 292
Registered: ‎07-31-2013

Re: Scoop issue with Oozie

Could you share your full failed action log? The WARN about the SQOOP_CONF_DIR can be ignored, and is not the cause of the exit. The real reason is printed likely into the stderr/stdout parts.
Announcements
New solutions