Support Questions
Find answers, ask questions, and share your expertise

spark job gives " java.io.EOFException: Unexpected EOF while trying to read response from server " error

spark job gives " java.io.EOFException: Unexpected EOF while trying to read response from server " error

New Contributor

pache.hadoop.hdfs.DataStreamer run - Exception for BP-890279762-147.22.18.13-1450824261954:blk_1215757593_143649958
java.io.EOFException: Unexpected EOF while trying to read response from server
at org.apache.hadoop.hdfs.protocolPB.PBHelperClient.vintPrefixed(PBHelperClient.java:539)

Hi ,

 

Spark job give the below error please provide an solution to fix this.

 

at org.apache.hadoop.hdfs.protocol.datatransfer.PipelineAck.readFields(PipelineAck.java:213)
at org.apache.hadoop.hdfs.DataStreamer$ResponseProcessor.run(DataStreamer.java:1086)
[WARN] 2021-02-07 08:16:22,098 org.apache.hadoop.hdfs.DataStreamer handleBadDatanode - Error Recovery for BP-890279762-147.22.18.13-1450824261954:blk_1215757593_143649958 in pipeline [DatanodeInfoWithStorage[147.22.18.1:1004,DS-32c91853-cdae-4020-99fa-40a22a96830a,DISK], DatanodeInfoWithStorage[147.22.18.22:1004,DS-4f7f5c87-7790-4419-9b77-bbad65dd5a00,DISK], DatanodeInfoWithStorage[147.22.18.20:1004,DS-db06ea47-d7fa-488a-8b00-4ac6a0773df4,DISK]]: datanode 0(DatanodeInfoWithStorage[147.22.18.1:1004,DS-32c91853-cdae-4020-99fa-40a22a96830a,DISK]) is bad.

3 REPLIES 3

Re: spark job gives " java.io.EOFException: Unexpected EOF while trying to read response from server " error

Master Collaborator

@moni Is the data node healthy? This seems issue with DN is not healthy. 


Cheers!
Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.

Re: spark job gives " java.io.EOFException: Unexpected EOF while trying to read response from server " error

New Contributor

we did check with the Unix OS team  and net work team .. they say the data nodes are healthy

Re: spark job gives " java.io.EOFException: Unexpected EOF while trying to read response from server " error

Master Collaborator

@moni In that case we might have to take a look at full log file. There could be some other information. 


Cheers!
Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.