- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Oozie Workflow with Sqoop Action to Oracle Database Problem
- Labels:
-
Apache Oozie
-
Apache Sqoop
Created ‎11-08-2016 03:25 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hey guys,
I am new with HDP (v2.5 as Sandbox) and I am trying to submit an Oozie job using a Sqoop action to connect to an Oracle Database. I managed to run Oozie jobs with a simple Hive action and a simple Sqoop action (just sending 'version') - both worked. The error occurs when sending the command:
<command>sqoop-list-tables --connect jdbc:oracle:thin:@//XX.XX.XX.XXX:XXXX/NAME --username USER --password PW</command>
The error is:
2016-11-08 15:14:46,581 WARN SqoopActionExecutor:523 - SERVER[sandbox.hortonworks.com] USER[root] GROUP[-] TOKEN[] APP[sqoopaction] JOB[0000065-161107122627815-oozie-oozi-W] ACTION[0000065-161107122627815-oozie-oozi-W@sqoopjob] Launcher ERROR, reason: Main class [org.apache.oozie.action.hadoop.SqoopMain], exit code [1]
Actually, the command is working from the command line so it has something to do with Oozie. At some point I have read that there might be an issue with the ojdbc6.jar file so I copied it to several /lib/ folders without success. To get rid of the spaces inbetween the command I also tried <arg></arg> but it didn't work.
What am I doing wrong here? Any advice is appreciated! I really have no clue what to do and the error log doesn't help.
Thanks and regards,
Ken
(If you need further information just let me know!)
-------------
job.properties:
nameNode=hdfs://sandbox.hortonworks.com:8020 jobTracker=hdfs://sandbox.hortonworks.com:8050 queueName=default oozie.libpath=${nameNode}/user/oozie/share/lib oozie.wf.application.path=data/oozie/sqoopaction oozie.use.system.libpath=true oozie.action.sharelib.for.sqoop = hive,hcatalog,sqoop
Created ‎11-09-2016 08:58 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
It seems that I managed to solve the problem.
What was missing:
oozie admin -oozie http://localhost:11000/oozie -sharelibupdate
One can check the share lib by
oozie admin -oozie http://localhost:11000/oozie -shareliblist sqoop
I hope this helps also others and this should be the same for different database systems.
Created ‎11-09-2016 08:58 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
It seems that I managed to solve the problem.
What was missing:
oozie admin -oozie http://localhost:11000/oozie -sharelibupdate
One can check the share lib by
oozie admin -oozie http://localhost:11000/oozie -shareliblist sqoop
I hope this helps also others and this should be the same for different database systems.
