28807
DISCUSSIONS
102207
MEMBERS
3161
ARTICLES
Created 07-09-2019 09:05 PM
When writing data to our hdfs cluster, occasionally I get the following error:
2019-07-09 15:59:07.746 INFO [org.apache.hadoop.hdfs.DataStreamer] (Thread-429765:system) Exception in createBlockOutputStream blk_1074920007_36859614: java.io.EOFException: Unexpected EOF while trying to read response from server at org.apache.hadoop.hdfs.protocolPB.PBHelperClient.vintPrefixed(PBHelperClient.java:458) at org.apache.hadoop.hdfs.DataStreamer.createBlockOutputStream(DataStreamer.java:1762) at org.apache.hadoop.hdfs.DataStreamer.setupPipelineInternal(DataStreamer.java:1507) at org.apache.hadoop.hdfs.DataStreamer.setupPipelineForAppendOrRecovery(DataStreamer.java:1481) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:720) 2019-07-09 15:59:07.914 WARN [org.apache.hadoop.hdfs.DataStreamer] (Thread-429765:system) Error Recovery for BP-2047192215-10.1.22.91-1559614202478:blk_1074920007_36859614 in pipeline [DatanodeInfoWithStorage[10.1.22.91:50010,DS-b0b8726d-4196-4a4b-94b2-914b188051ea,DISK], DatanodeInfoWithStorage[10.1.22.93:50010,DS-0adab02c-ba51-45a3-ac70-8a0a6075b343,DISK]]: datanode 0(DatanodeInfoWithStorage[10.1.22.91:50010,DS-b0b8726d-4196-4a4b-94b2-914b188051ea,DISK]) is bad.
Could this be a timeout issue? If so, any idea which timeout needs to be adjusted? If not, what else could cause this issue?