Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

java.io.EOFException while running sqoop import in Hue Shell job

java.io.EOFException while running sqoop import in Hue Shell job

New Contributor

I'm trying to simply import some data from Oracle DB into HDFS.

I have shell script that basically launches 'sqoop import' command. I tried to run it locally on my server and it worked well. Then I uploaded it into HDFS, created job in HUE and then I got this error:

 

Stdoutput 18/05/25 17:32:23 WARN security.UserGroupInformation: PriviledgedActionException as: (auth:SIMPLE) cause:java.io.EOFException: End of File Exception between local host is: "node04.example.com/10.10.173.185"; destination host is: "node01.example.com":8020; : java.io.EOFException; For more details see: http://wiki.apache.org/hadoop/EOFException
Stdoutput 18/05/25 17:32:23 ERROR tool.ImportTool: Import failed: java.io.EOFException: End of File Exception between local host is: "node04.example.com/10.10.173.185"; destination host is: "node01.example.com":8020; : java.io.EOFException; For more details see: http://wiki.apache.org/hadoop/EOFException
Stdoutput at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
Stdoutput at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
Stdoutput at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
Stdoutput at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
Stdoutput at org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:791)
Stdoutput at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:764)
Stdoutput at org.apache.hadoop.ipc.Client.call(Client.java:1508)
Stdoutput at org.apache.hadoop.ipc.Client.call(Client.java:1441)
Stdoutput at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:230)
Stdoutput at com.sun.proxy.$Proxy12.getFileInfo(Unknown Source)
Stdoutput at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getFileInfo(ClientNamenodeProtocolTranslatorPB.java:786)
Stdoutput at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
Stdoutput at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
Stdoutput at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
Stdoutput at java.lang.reflect.Method.invoke(Method.java:498)
Stdoutput at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:258)
Stdoutput at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:104)
Stdoutput at com.sun.proxy.$Proxy13.getFileInfo(Unknown Source)
Stdoutput at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:2167)
Stdoutput at org.apache.hadoop.hdfs.DistributedFileSystem$20.doCall(DistributedFileSystem.java:1265)
Stdoutput at org.apache.hadoop.hdfs.DistributedFileSystem$20.doCall(DistributedFileSystem.java:1261)
Stdoutput at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
Stdoutput at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1261)
Stdoutput at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1418)
Stdoutput at org.apache.hadoop.mapreduce.lib.output.FileOutputFormat.checkOutputSpecs(FileOutputFormat.java:145)
Stdoutput at org.apache.hadoop.mapreduce.JobSubmitter.checkSpecs(JobSubmitter.java:270)
Stdoutput at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:143)
Stdoutput at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1307)
Stdoutput at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1304)
Stdoutput at java.security.AccessController.doPrivileged(Native Method)
Stdoutput at javax.security.auth.Subject.doAs(Subject.java:422)
Stdoutput at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1920)
Stdoutput at org.apache.hadoop.mapreduce.Job.submit(Job.java:1304)
Stdoutput at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1325)
Stdoutput at org.apache.sqoop.mapreduce.ImportJobBase.doSubmitJob(ImportJobBase.java:203)
Stdoutput at org.apache.sqoop.mapreduce.ImportJobBase.runJob(ImportJobBase.java:176)
Stdoutput at org.apache.sqoop.mapreduce.ImportJobBase.runImport(ImportJobBase.java:273)
Stdoutput at org.apache.sqoop.manager.SqlManager.importQuery(SqlManager.java:748)
Stdoutput at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:515)
Stdoutput at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:621)
Stdoutput at org.apache.sqoop.Sqoop.run(Sqoop.java:147)
Stdoutput at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
Stdoutput at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:183)
Stdoutput at org.apache.sqoop.Sqoop.runTool(Sqoop.java:234)
Stdoutput at org.apache.sqoop.Sqoop.runTool(Sqoop.java:243)
Stdoutput at org.apache.sqoop.Sqoop.main(Sqoop.java:252)
Stdoutput Caused by: java.io.EOFException
Stdoutput at java.io.DataInputStream.readInt(DataInputStream.java:392)
Stdoutput at org.apache.hadoop.ipc.Client$Connection.receiveRpcResponse(Client.java:1113)
Stdoutput at org.apache.hadoop.ipc.Client$Connection.run(Client.java:1006)
Stdoutput
Exit code of the Shell command 1
<<< Invocation of Shell command completed <<<


<<< Invocation of Main class completed <<<

Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.ShellMain], exit code [1]

Oozie Launcher failed, finishing Hadoop job gracefully

 

I have no clue what I'm doing wrong. How to solve this?

 

5 REPLIES 5

Re: java.io.EOFException while running sqoop import in Hue Shell job

New Contributor

Can somebody help me with this?

Re: java.io.EOFException while running sqoop import in Hue Shell job

Champion

are you still facing the issue ? could you let me know 

Re: java.io.EOFException while running sqoop import in Hue Shell job

New Contributor
Yep, still reproducing

Re: java.io.EOFException while running sqoop import in Hue Shell job

Champion

Could you the share the HUE / mapreduce log trace ? 

also do you have Namenode HA configured ? 

Highlighted

Re: java.io.EOFException while running sqoop import in Hue Shell job

New Contributor
Sorry, was on vacations.
I have one NameNmode and one SecondaryNameNode on different hosts.

Where can I find those traces that you need?