Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

oozie workflow failed in sqoop command

oozie workflow failed in sqoop command

New Contributor

Hello all, I am successfully able to run the sqoop command. But when I added to oozie workflow xml I am not able to do with oozie. I received STATUS as KILLED. The error code is JA018.

Here is my workflow:

<workflow-app xmlns="uri:oozie:workflow:0.4" name="oozie-wf">

<start to="sqoop-wf"/>

<action name="sqoop-wf"> <sqoop xmlns="uri:oozie:sqoop-action:0.2">

<job-tracker>${jobTracker}</job-tracker>

<name-node>${nameNode}</name-node>

<command>import --connect jdbc:oracle:thin:@dbservername:1521:database --username user --password passwprd --query "SELECT TASKID FROM TASKS WHERE TASKTIMESTAMP BETWEEN TO_DATE('2017-02-13 00:00:00', 'yyyy-mm-dd hh24:mi:ss') AND TO_DATE('2017-02-13 23:59:59', 'yyyy-mm-dd hh24:mi:ss') AND \$CONDITIONS" --fields-terminated-by '|' -m 1 --target-dir /dbdata/mytest</command>

</sqoop>

<ok to="end"/>

<error to="fail"/>

</action>

<kill name="fail">

<message>Failed, Error Message[${wf:errorMessage(wf:lastErrorNode())}]</message>

</kill> <end name="end"/> </workflow-app>

Could someone please help me? I am new to oozie and I stuck with this error for awhile.

Thanks in advance

2 REPLIES 2

Re: oozie workflow failed in sqoop command

Mentor

are you doing this on HDP 2.5? Please go to the job in Resource Manager and paste the actual error. Also, I have an article you can review for some common gotchas on HDP 2.5, specifically with Hive import. Doesn't look like that's what you're doing but your error code points to Hive. https://community.hortonworks.com/articles/84394/apache-ambari-workflow-manager-view-for-apache-ooz-...

Re: oozie workflow failed in sqoop command

New Contributor

hi Arvits;

I am using HDP 2.4.2.0. I am trying to import data from database into hdfs using oozie workflow. I have questions to ask you, that I execute the oozie command as mapred user but I keep getting permission denied: user=mapred, access=READ. I have directory owned by mapred (drwxrwxrwx - mapred hadoop 0 2016-11-01 09:40 /mr-history) however, when oozie job started somewhere generate the job by hdfs and changed mapred user to read only. Can you please show me where I can set or change the hdfs permission to mapred? Pls see below log:

Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.AccessControlException): Permission denied: user=mapred, access=READ, inode="/mr-history/tmp/hdfs/job_1487105716370_1426.summary":hdfs:hdfs:-rwxrwx---
	at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:319)
	at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:219)
	at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:190)
	
Don't have an account?
Coming from Hortonworks? Activate your account here