<?xml version="1.0" encoding="UTF-8"?>
<rss xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:taxo="http://purl.org/rss/1.0/modules/taxonomy/" version="2.0">
  <channel>
    <title>question Re: Copying Data to HDFS takes too much time in Support Questions</title>
    <link>https://community.cloudera.com/t5/Support-Questions/Copying-Data-to-HDFS-takes-too-much-time/m-p/164629#M126996</link>
    <description>&lt;P&gt;&lt;A rel="user" href="https://community.cloudera.com/users/1348/hari.html" nodeid="1348"&gt;@hari kiran&lt;/A&gt;&lt;/P&gt;&lt;P&gt; There might be network issue&lt;/P&gt;&lt;PRE&gt;SYMPTOM:
Reading/writing of data with HDFS --put, 

ROOT CAUSE:

The message  "Slow-BlockReceiver-write-packet-to-mirror" is normally an indication that there is a problem with  with underlying networking infrastructure. 

SOLUTION:

Ensure from the OS level that the networking as well as NIC parameters are set up correctly.

                     - verify that MTU value set up as expected
                     - communication mode is correct (full-duplex)
                     - there are not too many errors at the interface level (dropped/overruns)

COMMANDS TO USE FOR DEBUGGING:

#dmesg   &amp;lt;-- identify issues with NIC device driver
#ifconfig -a  &amp;lt;-- MTU, errorrs (dropped packets/buffer overruns)
#ethtool ethX  &amp;lt;--  identify/set speed/ negotiation mode/ duplex setting for the inferface

In addition, running iperf between datanodes will highlight overall networks transfer issues.

#iperf -s (server)  

#iperf -c 10.1.1.1 -f m -d (client)
&lt;/PRE&gt;</description>
    <pubDate>Tue, 24 May 2016 17:13:30 GMT</pubDate>
    <dc:creator>sshimpi</dc:creator>
    <dc:date>2016-05-24T17:13:30Z</dc:date>
  </channel>
</rss>

