Welcome to the Cloudera Community

Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Who agreed with this topic

createBlockOutputStream yields Unexpected EOF while trying to read response from server

avatar
Contributor

When writing data to our hdfs cluster, occasionally I get the following error:

2019-07-09 15:59:07.746 INFO [org.apache.hadoop.hdfs.DataStreamer] (Thread-429765:system) Exception in createBlockOutputStream blk_1074920007_36859614: java.io.EOFException: Unexpected EOF while trying to read response from server
        at org.apache.hadoop.hdfs.protocolPB.PBHelperClient.vintPrefixed(PBHelperClient.java:458)
        at org.apache.hadoop.hdfs.DataStreamer.createBlockOutputStream(DataStreamer.java:1762)
        at org.apache.hadoop.hdfs.DataStreamer.setupPipelineInternal(DataStreamer.java:1507)
        at org.apache.hadoop.hdfs.DataStreamer.setupPipelineForAppendOrRecovery(DataStreamer.java:1481)
        at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:720)

2019-07-09 15:59:07.914 WARN [org.apache.hadoop.hdfs.DataStreamer] (Thread-429765:system) Error Recovery for BP-2047192215-10.1.22.91-1559614202478:blk_1074920007_36859614 in pipeline [DatanodeInfoWithStorage[10.1.22.91:50010,DS-b0b8726d-4196-4a4b-94b2-914b188051ea,DISK], DatanodeInfoWithStorage[10.1.22.93:50010,DS-0adab02c-ba51-45a3-ac70-8a0a6075b343,DISK]]: datanode 0(DatanodeInfoWithStorage[10.1.22.91:50010,DS-b0b8726d-4196-4a4b-94b2-914b188051ea,DISK]) is bad.

Could this be a timeout issue? If so, any idea which timeout needs to be adjusted? If not, what else could cause this issue?

Who agreed with this topic