I am trying to run sqoop command by shell script. I am trying to execute that script as shell sction in Oozie. But the job is getting killed. The oozie command is running fine otherwise.
Below is the sqoop command given inside the shell script.
sqoop import --connect jdbc:oracle:thin:@//orcl.*******:1521/orcl --username ****--password ****--table TEST_SQOOP --target-dir /user/hadoop/test -m 1
Below is the job.properties file.
Note: I am able to run usual operation by shell script without any issues.
@Gaurab D since you are invoking sqoop from oozie, you must have oozie client installed on all data nodes. Oozie may execute the workflow from any node and that is why you need sqoop client installed on all nodes. Please verify that is complete on your cluster.
@Gaurab D yes but you need to do extra steps:
If you use sqoop to import into hive table then you can do this all in hive action. more on that in this tutorial.
I am getting below error while running a simple sqoop import command using oracle. That Sqoop command is working fine without oozie.
2016-08-22 08:49:30,013 WARN ShellActionExecutor:523 - SERVER[ip-172-31-31-66.ec2.internal] USER[hadoop] GROUP[-] TOKEN APP[shell-wf] JOB[0000121-160802050043050-oozie-oozi-W] ACTION[0000121-160802050043050-oozie-oozi-W@shell-node] Launcher ERROR, reason: Main class [org.apache.oozie.action.hadoop.ShellMain], exit code