Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Exception in createBlockOutputStream when puting file into hdfs

Exception in createBlockOutputStream when puting file into hdfs

New Contributor

When I am copying file to hdfs from my local. I am getting exception in createBlockOutputStream. I am getting something similar even when I am trying to read a file in pyspark from hdfs. Also my operations are getting successful but I am getting these errors messages whenever I do some I/O operation on hdfs.


19/04/26 21:39:35 INFO hdfs.DataStreamer: Exception in createBlockOutputStream blk_1080253190_6629387 java.io.IOException: Got error, status=ERROR, status message , ack with firstBadLink as [dn_ip]:1019 at org.apache.hadoop.hdfs.protocol.datatransfer.DataTransferProtoUtil.checkBlockOpStatus(DataTransferProtoUtil.java:134) at org.apache.hadoop.hdfs.protocol.datatransfer.DataTransferProtoUtil.checkBlockOpStatus(DataTransferProtoUtil.java:110) at org.apache.hadoop.hdfs.DataStreamer.createBlockOutputStream(DataStreamer.java:1778) at org.apache.hadoop.hdfs.DataStreamer.nextBlockOutputStream(DataStreamer.java:1679) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:716) 19/04/26 21:39:35 WARN hdfs.DataStreamer: Abandoning BP-76855237-192.168.54.40-1517519869441:blk_1080253190_6629387 19/04/26 21:39:35 WARN hdfs.DataStreamer: Excluding datanode DatanodeInfoWithStorage[10.0.6.0:1019,DS-c9f606db-f6b4-45a3-944b-ff52c1f5ac9e,DISK] 19/04/26 21:39:35 WARN hdfs.DataStreamer: Slow waitForAckedSeqno took 70301ms (threshold=30000ms). File being written: /user/yogesh/libs.zip.COPYING, block: BP-76855237-192.168.54.40-1517519869441:blk_1080253193_6629390, Write pipeline datanodes: [DatanodeInfoWithStorage[10.0.6.1:1019,DS-c4af7074-18aa-4d41-90af-1b338d365770,DISK], DatanodeInfoWithStorage[10.0.6.3:1019,DS-6a43ad83-c974-4726-b2ab-ccb780e9a729,DISK], DatanodeInfoWithStorage[10.0.6.2:1019,DS-e19cd6bc-232e-44cb-84cd-5fc63a08d487,DISK]].
Don't have an account?
Coming from Hortonworks? Activate your account here