Reply
New Contributor
Posts: 4
Registered: ‎05-25-2018

java.io.EOFException while running sqoop import in Hue Shell job

I'm trying to simply import some data from Oracle DB into HDFS.

I have shell script that basically launches 'sqoop import' command. I tried to run it locally on my server and it worked well. Then I uploaded it into HDFS, created job in HUE and then I got this error:

 

Stdoutput 18/05/25 17:32:23 WARN security.UserGroupInformation: PriviledgedActionException as: (auth:SIMPLE) cause:java.io.EOFException: End of File Exception between local host is: "node04.example.com/10.10.173.185"; destination host is: "node01.example.com":8020; : java.io.EOFException; For more details see: http://wiki.apache.org/hadoop/EOFException
Stdoutput 18/05/25 17:32:23 ERROR tool.ImportTool: Import failed: java.io.EOFException: End of File Exception between local host is: "node04.example.com/10.10.173.185"; destination host is: "node01.example.com":8020; : java.io.EOFException; For more details see: http://wiki.apache.org/hadoop/EOFException
Stdoutput at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
Stdoutput at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
Stdoutput at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
Stdoutput at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
Stdoutput at org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:791)
Stdoutput at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:764)
Stdoutput at org.apache.hadoop.ipc.Client.call(Client.java:1508)
Stdoutput at org.apache.hadoop.ipc.Client.call(Client.java:1441)
Stdoutput at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:230)
Stdoutput at com.sun.proxy.$Proxy12.getFileInfo(Unknown Source)
Stdoutput at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getFileInfo(ClientNamenodeProtocolTranslatorPB.java:786)
Stdoutput at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
Stdoutput at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
Stdoutput at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
Stdoutput at java.lang.reflect.Method.invoke(Method.java:498)
Stdoutput at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:258)
Stdoutput at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:104)
Stdoutput at com.sun.proxy.$Proxy13.getFileInfo(Unknown Source)
Stdoutput at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:2167)
Stdoutput at org.apache.hadoop.hdfs.DistributedFileSystem$20.doCall(DistributedFileSystem.java:1265)
Stdoutput at org.apache.hadoop.hdfs.DistributedFileSystem$20.doCall(DistributedFileSystem.java:1261)
Stdoutput at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
Stdoutput at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1261)
Stdoutput at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1418)
Stdoutput at org.apache.hadoop.mapreduce.lib.output.FileOutputFormat.checkOutputSpecs(FileOutputFormat.java:145)
Stdoutput at org.apache.hadoop.mapreduce.JobSubmitter.checkSpecs(JobSubmitter.java:270)
Stdoutput at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:143)
Stdoutput at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1307)
Stdoutput at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1304)
Stdoutput at java.security.AccessController.doPrivileged(Native Method)
Stdoutput at javax.security.auth.Subject.doAs(Subject.java:422)
Stdoutput at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1920)
Stdoutput at org.apache.hadoop.mapreduce.Job.submit(Job.java:1304)
Stdoutput at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1325)
Stdoutput at org.apache.sqoop.mapreduce.ImportJobBase.doSubmitJob(ImportJobBase.java:203)
Stdoutput at org.apache.sqoop.mapreduce.ImportJobBase.runJob(ImportJobBase.java:176)
Stdoutput at org.apache.sqoop.mapreduce.ImportJobBase.runImport(ImportJobBase.java:273)
Stdoutput at org.apache.sqoop.manager.SqlManager.importQuery(SqlManager.java:748)
Stdoutput at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:515)
Stdoutput at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:621)
Stdoutput at org.apache.sqoop.Sqoop.run(Sqoop.java:147)
Stdoutput at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
Stdoutput at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:183)
Stdoutput at org.apache.sqoop.Sqoop.runTool(Sqoop.java:234)
Stdoutput at org.apache.sqoop.Sqoop.runTool(Sqoop.java:243)
Stdoutput at org.apache.sqoop.Sqoop.main(Sqoop.java:252)
Stdoutput Caused by: java.io.EOFException
Stdoutput at java.io.DataInputStream.readInt(DataInputStream.java:392)
Stdoutput at org.apache.hadoop.ipc.Client$Connection.receiveRpcResponse(Client.java:1113)
Stdoutput at org.apache.hadoop.ipc.Client$Connection.run(Client.java:1006)
Stdoutput
Exit code of the Shell command 1
<<< Invocation of Shell command completed <<<


<<< Invocation of Main class completed <<<

Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.ShellMain], exit code [1]

Oozie Launcher failed, finishing Hadoop job gracefully

 

I have no clue what I'm doing wrong. How to solve this?

 

New Contributor
Posts: 4
Registered: ‎05-25-2018

Re: java.io.EOFException while running sqoop import in Hue Shell job

Can somebody help me with this?

Champion
Posts: 731
Registered: ‎05-16-2016

Re: java.io.EOFException while running sqoop import in Hue Shell job

are you still facing the issue ? could you let me know 

New Contributor
Posts: 4
Registered: ‎05-25-2018

Re: java.io.EOFException while running sqoop import in Hue Shell job

Yep, still reproducing
Champion
Posts: 731
Registered: ‎05-16-2016

Re: java.io.EOFException while running sqoop import in Hue Shell job

[ Edited ]

Could you the share the HUE / mapreduce log trace ? 

also do you have Namenode HA configured ? 

New Contributor
Posts: 4
Registered: ‎05-25-2018

Re: java.io.EOFException while running sqoop import in Hue Shell job

Sorry, was on vacations.
I have one NameNmode and one SecondaryNameNode on different hosts.

Where can I find those traces that you need?
Announcements