Community Articles

Find and share helpful community-sourced technical articles.
Labels (1)
avatar
Master Guru

SYMPTOM:

Oozie sqoop action fails with below error while inserting data into Hive.

20217 [Thread-30] INFO org.apache.sqoop.hive.HiveImport - Sorry ! hive-shell is disabled use 'Beeline' or 'Hive View' instead. Please contact cluster administrators for further information 
20218 [main] ERROR org.apache.sqoop.tool.ImportTool - Encountered IOException running import job: java.io.IOException: Hive exited with status 1 
at org.apache.sqoop.hive.HiveImport.executeExternalHiveScript(HiveImport.java:389) 
at org.apache.sqoop.hive.HiveImport.executeScript(HiveImport.java:342) 
at org.apache.sqoop.hive.HiveImport.importTable(HiveImport.java:246) 
at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:524) 
at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:615) 
at org.apache.sqoop.tool.JobTool.execJob(JobTool.java:243) 
at org.apache.sqoop.tool.JobTool.run(JobTool.java:298) 
at org.apache.sqoop.Sqoop.run(Sqoop.java:147) 
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76) 
at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:183) 
at org.apache.sqoop.Sqoop.runTool(Sqoop.java:225) 
at org.apache.sqoop.Sqoop.runTool(Sqoop.java:234) 
at org.apache.sqoop.Sqoop.main(Sqoop.java:243) 
at org.apache.oozie.action.hadoop.SqoopMain.runSqoopJob(SqoopMain.java:202) 
at org.apache.oozie.action.hadoop.SqoopMain.run(SqoopMain.java:182) 
at org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:51) 
at org.apache.oozie.action.hadoop.SqoopMain.main(SqoopMain.java:48) 
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 
at java.lang.reflect.Method.invoke(Method.java:498) 
at org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:242) 
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54) 
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453) 
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343) 
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168) 
at java.security.AccessController.doPrivileged(Native Method) 
at javax.security.auth.Subject.doAs(Subject.java:422) 
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1724) 
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:162)

.

ROOT CAUSE:

Sqoop uses CliDriver class and does not use hive script whereas Oozie was not able to find that class in classpath hence it was trying to use hive cli.

.

WORKAROUND:

N/A

.

RESOLUTION:

Add below property in job.properties file and re-run failed Oozie workflow.

oozie.action.sharelib.for.sqoop=sqoop,hive 
987 Views
0 Kudos