11-16-2014 07:04 PM
i have filed a issue list in CM forum area, but the Cloudera supporter told me about oozie issue should send to here, so i paster these to here.
prior to paster the issue here, i'd like to introduce my issue of oozie sqoop job. everything is ok before i enable kerberos, but oozie sqoop job failed after enable kerberos.
OOZIE errors while using sqoop import data(this is a very urgent case, since i still didn't resolve issue)
the sqoop command:
import -connect jdbc:mysql://10.32.87.4:3306/mdmuser -username admin -password xxx -table t_phone -hive-table t_phone -hive-database report -hive-import -hive-overwrite -null-string \\N -null-non-string \\N -hive-drop-import-delims -fields-terminated-by \001 -lines-terminated-by \n -m 1
完成 状态 名称 持续时间 提交者 上次修改 Id
|Sun, 16 Nov 2014 06:14:32||KILLED||Sqoop_Chris||21m:4s||hue||Sun, 16 Nov 2014 06:14:32||0000000-141116214447513-oozie-oozi-W|
|Sun, 16 Nov 2014 05:33:53||SUCCEEDED||Sqoop_Chris||56s||hue||Sun, 16 Nov 2014 05:33:53||0000001-141116211525787-oozie-oozi-W|
i think you will ask me what's errors in container or logs,
the standout like below :
35331 [main] WARN org.apache.sqoop.hive.TableDefWriter - Column updated_time had to be cast to a less precise type in Hive 35341 [main] INFO org.apache.sqoop.hive.HiveImport - Loading uploaded data into Hive Heart beat Heart beat Heart beat Heart beat Heart beat Heart beat Heart beat Heart beat Heart beat Heart beat Heart beat Heart beat Heart beat Heart beat Heart beat Heart beat Heart beat Heart beat Heart beat Heart beat Heart beat Heart beat Heart beat Heart beat Heart beat Heart beat Heart beat Heart beat Heart beat Heart beat Heart beat Heart beat Heart beat Heart beat Heart beat Heart beat Heart beat Heart beat Heart beat Heart beat Intercepting System.exit(1)
the standerr is ;
14/11/16 21:54:27 WARN conf.HiveConf: DEPRECATED: Configuration property hive.metastore.local no longer has any effect. Make sure to provide a valid value for hive.metastore.uris if you are connecting to a remote metastore. Logging initialized using configuration in jar:file:/yarn/nm/filecache/791/hive-exec-0.13.1-cdh5.2.0.jar!/hive-log4j.properties FAILED: IllegalStateException Unxpected Exception thrown: Table not found t_phone Intercepting System.exit(1) Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.SqoopMain], exit code [1
this is very strange case, since the sqoop command has been finished success, and the data also in the tmp directory(/user/hue), but while load these data into HIVE, then it's awalys Heart beat(i don't know what does oozie doing, maybe find something.)
as you can see this job is success before enable kerberos, so don't doubt my table is not exist, if i add -create-hive-table tag, then it will show database not found.
about container log, nothing useful i have found.
i have checked the warehouse permission, you kow it's no problem. anyway, i didn't find useful information.
11-17-2014 05:28 PM
hi, Cloudera support, coule you give me some advises, since i have been suspended on this issue for one week.
i don't know why OOZIE sqoop job always heartbeat while kerberos enable.
11-18-2014 05:21 AM
11-19-2014 08:23 AM
who is this forum manager? i know this website does not gurantee to reply every message, but could you give me some advises ?
i don't know you guys have tested oozie sqoop function, but i have tested many times, either upgrade from CDH5.1 or new installation of CDH5.2, this issue always happend. and you konw, sometimes HADOOP erros is no useful for us , we can't get any direction from these errors.
hope can pay a little attention on this issue. thanks.
11-20-2014 01:51 PM
Does the sqoop command work fine without using Oozie on a kerberized cluster? Just wanted to confirm as I didn't see it mentioned anywhere earlier.
Typically we recommend a two phase approach with Sqoop in Oozie, especially when using kerberos. By this, we mean use Sqoop to dump the Data from your DB to HDFS. Then run a Hive action that loads the data from HDFS into Hive. Having said that, I think it might work if you use Hcat credentials in your Sqoop action. To do this:
- Right after the first line of your workflow, add a credentials section like:
<workflow-app xmlns="uri:oozie:workflow:0.4" name="hive-wf">
<credential name='hcat_creds' type='hcat'>
- Then include the hcat credentials in your sqoop action, like:
<action name="sqoop-action" cred='hcat_creds'>
Can you try this and see if it helps?
11-20-2014 11:45 PM
yes, the oozie sqoop job is success before enable kerberos.
your suggestion is unacceptable for me, since sqoop can import data from mysql or oracle to hive directly. i just wonder, why oozie sqoop job failed after enable kerberos, and prompt the table not found. and if i add -create-hive-table, then prompt database not found.
about your suggestion i will try, but this is not best solution.
11-30-2014 04:33 AM
02-10-2015 06:13 PM
Today I ran into the exact same issue.
After enabling kerberos, if 'Sqoop Action' tries to pull data from rdbms into HDFS and then import into Hive as part of ONE action, it will FAIL.
But as recommended above, if you SPLIT the SqoopAction into two, Sqoop action to pull data into HDFS and the Hive Action to upload data into Hive it works. You MUST use HCAT credentials in oozie workflow as suggested by cloudera above.
I think its a bug..