Created 11-08-2016 03:25 PM
Hey guys,
I am new with HDP (v2.5 as Sandbox) and I am trying to submit an Oozie job using a Sqoop action to connect to an Oracle Database. I managed to run Oozie jobs with a simple Hive action and a simple Sqoop action (just sending 'version') - both worked. The error occurs when sending the command:
<command>sqoop-list-tables --connect jdbc:oracle:thin:@//XX.XX.XX.XXX:XXXX/NAME --username USER --password PW</command>
The error is:
2016-11-08 15:14:46,581 WARN SqoopActionExecutor:523 - SERVER[sandbox.hortonworks.com] USER[root] GROUP[-] TOKEN[] APP[sqoopaction] JOB[0000065-161107122627815-oozie-oozi-W] ACTION[0000065-161107122627815-oozie-oozi-W@sqoopjob] Launcher ERROR, reason: Main class [org.apache.oozie.action.hadoop.SqoopMain], exit code [1]
Actually, the command is working from the command line so it has something to do with Oozie. At some point I have read that there might be an issue with the ojdbc6.jar file so I copied it to several /lib/ folders without success. To get rid of the spaces inbetween the command I also tried <arg></arg> but it didn't work.
What am I doing wrong here? Any advice is appreciated! I really have no clue what to do and the error log doesn't help.
Thanks and regards,
Ken
(If you need further information just let me know!)
-------------
job.properties:
nameNode=hdfs://sandbox.hortonworks.com:8020 jobTracker=hdfs://sandbox.hortonworks.com:8050 queueName=default oozie.libpath=${nameNode}/user/oozie/share/lib oozie.wf.application.path=data/oozie/sqoopaction oozie.use.system.libpath=true oozie.action.sharelib.for.sqoop = hive,hcatalog,sqoop
Created 11-09-2016 08:58 AM
It seems that I managed to solve the problem.
What was missing:
oozie admin -oozie http://localhost:11000/oozie -sharelibupdate
One can check the share lib by
oozie admin -oozie http://localhost:11000/oozie -shareliblist sqoop
I hope this helps also others and this should be the same for different database systems.
Created 11-09-2016 08:58 AM
It seems that I managed to solve the problem.
What was missing:
oozie admin -oozie http://localhost:11000/oozie -sharelibupdate
One can check the share lib by
oozie admin -oozie http://localhost:11000/oozie -shareliblist sqoop
I hope this helps also others and this should be the same for different database systems.