Support Questions

Find answers, ask questions, and share your expertise
Announcements
Check out our newest addition to the community, the Cloudera Data Analytics (CDA) group hub.

When running a list of Sqoop Jobs I am encountering this exeception HCatOutputFormat not initialized, setOutput has to be called on the 2nd sqoop job run. The first always runs fine but the succeding always fails

2017-08-02 23:56:47.0059 DEBUG [main] (Cluster.java:90) [org.apache.hadoop.mapreduce.Cluster] - Trying ClientProtocolProvider : org.apache.hadoop.mapred.LocalClientProtocolProvider 2017-08-02 23:56:47.0060 INFO [main] (JvmMetrics.java:71) [org.apache.hadoop.metrics.jvm.JvmMetrics] - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized 2017-08-02 23:56:47.0060 DEBUG [main] (Cluster.java:103) [org.apache.hadoop.mapreduce.Cluster] - Picked org.apache.hadoop.mapred.LocalClientProtocolProvider as the ClientProtocolProvider cause:org.apache.hive.hcatalog.common.HCatException : 2004 : HCatOutputFormat not initialized, setOutput has to be called 2017-08-02 23:56:47.0061 DEBUG [main] (ClassLoaderStack.java:45) [org.apache.sqoop.util.ClassLoaderStack] - Restoring classloader: sun.misc.Launcher$AppClassLoader@70dea4e 2017-08-02 23:56:47.0062 ERROR [main] (ImportTool.java:613) [org.apache.sqoop.tool.ImportTool] - Encountered IOException running import job: org.apache.hive.hcatalog.common.HCatException : 2004 : HCatOutputFormat not initialized, setOutput has to be called at org.apache.hive.hcatalog.mapreduce.HCatBaseOutputFormat.getJobInfo(HCatBaseOutputFormat.java:102) at org.apache.hive.hcatalog.mapreduce.HCatBaseOutputFormat.getOutputFormat(HCatBaseOutputFormat.java:76) at org.apache.hive.hcatalog.mapreduce.HCatBaseOutputFormat.checkOutputSpecs(HCatBaseOutputFormat.java:65) at org.apache.hadoop.mapreduce.JobSubmitter.checkSpecs(JobSubmitter.java:266) at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:139) at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1290) at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1287) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1709) at org.apache.hadoop.mapreduce.Job.submit(Job.java:1287) at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1308) at org.apache.sqoop.mapreduce.ImportJobBase.doSubmitJob(ImportJobBase.java:196) at org.apache.sqoop.mapreduce.ImportJobBase.runJob(ImportJobBase.java:169) at org.apache.sqoop.mapreduce.ImportJobBase.runImport(ImportJobBase.java:266) at org.apache.sqoop.manager.SqlManager.importQuery(SqlManager.java:729) at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:499) at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:605) at master.invoker.sqoopLoader$.executeSqoopJob(sqoopLoader.scala:344)

1 REPLY 1

Hi Guys, If you can help me with this issue.

@jsensharma @mclark @tspann

Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.