Support Questions
Find answers, ask questions, and share your expertise

When running a list of Sqoop Jobs I am encountering this exeception HCatOutputFormat not initialized, setOutput has to be called on the 2nd sqoop job run. The first always runs fine but the succeding always fails

When running a list of Sqoop Jobs I am encountering this exeception HCatOutputFormat not initialized, setOutput has to be called on the 2nd sqoop job run. The first always runs fine but the succeding always fails

2017-08-02 23:56:47.0059 DEBUG [main] (Cluster.java:90) [org.apache.hadoop.mapreduce.Cluster] - Trying ClientProtocolProvider : org.apache.hadoop.mapred.LocalClientProtocolProvider 2017-08-02 23:56:47.0060 INFO [main] (JvmMetrics.java:71) [org.apache.hadoop.metrics.jvm.JvmMetrics] - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized 2017-08-02 23:56:47.0060 DEBUG [main] (Cluster.java:103) [org.apache.hadoop.mapreduce.Cluster] - Picked org.apache.hadoop.mapred.LocalClientProtocolProvider as the ClientProtocolProvider cause:org.apache.hive.hcatalog.common.HCatException : 2004 : HCatOutputFormat not initialized, setOutput has to be called 2017-08-02 23:56:47.0061 DEBUG [main] (ClassLoaderStack.java:45) [org.apache.sqoop.util.ClassLoaderStack] - Restoring classloader: sun.misc.Launcher$AppClassLoader@70dea4e 2017-08-02 23:56:47.0062 ERROR [main] (ImportTool.java:613) [org.apache.sqoop.tool.ImportTool] - Encountered IOException running import job: org.apache.hive.hcatalog.common.HCatException : 2004 : HCatOutputFormat not initialized, setOutput has to be called at org.apache.hive.hcatalog.mapreduce.HCatBaseOutputFormat.getJobInfo(HCatBaseOutputFormat.java:102) at org.apache.hive.hcatalog.mapreduce.HCatBaseOutputFormat.getOutputFormat(HCatBaseOutputFormat.java:76) at org.apache.hive.hcatalog.mapreduce.HCatBaseOutputFormat.checkOutputSpecs(HCatBaseOutputFormat.java:65) at org.apache.hadoop.mapreduce.JobSubmitter.checkSpecs(JobSubmitter.java:266) at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:139) at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1290) at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1287) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1709) at org.apache.hadoop.mapreduce.Job.submit(Job.java:1287) at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1308) at org.apache.sqoop.mapreduce.ImportJobBase.doSubmitJob(ImportJobBase.java:196) at org.apache.sqoop.mapreduce.ImportJobBase.runJob(ImportJobBase.java:169) at org.apache.sqoop.mapreduce.ImportJobBase.runImport(ImportJobBase.java:266) at org.apache.sqoop.manager.SqlManager.importQuery(SqlManager.java:729) at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:499) at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:605) at master.invoker.sqoopLoader$.executeSqoopJob(sqoopLoader.scala:344)

1 REPLY 1

Re: When running a list of Sqoop Jobs I am encountering this exeception HCatOutputFormat not initialized, setOutput has to be called on the 2nd sqoop job run. The first always runs fine but the succeding always fails

Hi Guys, If you can help me with this issue.

@jsensharma @mclark @tspann