Support Questions
Find answers, ask questions, and share your expertise

hadoop cluster with problem of slow BlockReceiver write data to disk

hadoop cluster with problem of slow BlockReceiver write data to disk

I'd like to submit a strange behavior while working with new Hadoop cluster, on a new hardware stack.

 

Once everything got installed, as soon as we try to perform any I/O operation on HDFS, we can see many of these messages within the datanode logs:

 

we see many lines in the data nodes logs as

 

WARN datanode.DataNode (BlockReceiver.java:receivePacket(701)) - Slow BlockReceiver write data to disk cost:29543ms (threshold=300ms), volume=/grid/sdb/hadoop/hdfs/data

 

what we can do about this ?

 

why data writing is slow?

Michael-Bronson