<?xml version="1.0" encoding="UTF-8"?>
<rss xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:taxo="http://purl.org/rss/1.0/modules/taxonomy/" version="2.0">
  <channel>
    <title>question distcp on cdh3u5 failing with timeout error in Archives of Support Questions (Read Only)</title>
    <link>https://community.cloudera.com/t5/Archives-of-Support-Questions/distcp-on-cdh3u5-failing-with-timeout-error/m-p/36202#M14870</link>
    <description>&lt;DIV class="IVILX2C-fd-a"&gt;&lt;DIV class="IVILX2C-tb-P"&gt;Hi,&lt;DIV&gt;&amp;nbsp;&lt;/DIV&gt;&lt;DIV&gt;&amp;nbsp; I am trying to backup dome data from our ancient hadoop cluster which is on cdh3u5 to S3 bucket with distcp. But my job is failing because some of the task are getting killed multiple times with following message&amp;nbsp;&lt;/DIV&gt;&lt;DIV&gt;&amp;nbsp;&lt;/DIV&gt;&lt;DIV&gt;&amp;nbsp; &amp;nbsp;&lt;PRE&gt;Task attempt_201404090636_336528_m_000112_0 failed to report status for 600 seconds. Killing!
Task attempt_201404090636_336528_m_000112_1 failed to report status for 600 seconds. Killing!
Task attempt_201404090636_336528_m_000112_2 failed to report status for 600 seconds. Killing!&lt;/PRE&gt;&lt;/DIV&gt;&lt;DIV&gt;&lt;DIV&gt;&amp;nbsp;&lt;/DIV&gt;&lt;/DIV&gt;&lt;DIV&gt;I was trying to distcp directory which has about ~1200 files with size 3MB - 5MB&lt;/DIV&gt;&lt;DIV&gt;&amp;nbsp;&lt;/DIV&gt;&lt;DIV&gt;We have 80 datanodes in the cluster.&lt;/DIV&gt;&lt;DIV&gt;&amp;nbsp;&lt;/DIV&gt;&lt;DIV&gt;&amp;nbsp;&lt;/DIV&gt;&lt;DIV&gt;Any help here with this please.&lt;/DIV&gt;&lt;DIV&gt;&amp;nbsp;&lt;/DIV&gt;&lt;DIV&gt;Thanks&lt;/DIV&gt;&lt;DIV&gt;roy&lt;/DIV&gt;&lt;/DIV&gt;&lt;DIV&gt;&amp;nbsp;&lt;/DIV&gt;&lt;DIV&gt;&amp;nbsp;&lt;/DIV&gt;&lt;/DIV&gt;&lt;DIV&gt;&amp;nbsp;&lt;/DIV&gt;&lt;DIV class="IVILX2C-tb-b"&gt;&lt;DIV class="IVILX2C-tb-a IVILX2C-tb-cb"&gt;&lt;DIV&gt;&lt;DIV&gt;&amp;nbsp;&lt;/DIV&gt;&lt;DIV class="IVILX2C-nd-a"&gt;&amp;nbsp;&lt;/DIV&gt;&lt;/DIV&gt;&lt;/DIV&gt;&lt;/DIV&gt;</description>
    <pubDate>Fri, 16 Sep 2022 09:57:03 GMT</pubDate>
    <dc:creator>Roy</dc:creator>
    <dc:date>2022-09-16T09:57:03Z</dc:date>
    <item>
      <title>distcp on cdh3u5 failing with timeout error</title>
      <link>https://community.cloudera.com/t5/Archives-of-Support-Questions/distcp-on-cdh3u5-failing-with-timeout-error/m-p/36202#M14870</link>
      <description>&lt;DIV class="IVILX2C-fd-a"&gt;&lt;DIV class="IVILX2C-tb-P"&gt;Hi,&lt;DIV&gt;&amp;nbsp;&lt;/DIV&gt;&lt;DIV&gt;&amp;nbsp; I am trying to backup dome data from our ancient hadoop cluster which is on cdh3u5 to S3 bucket with distcp. But my job is failing because some of the task are getting killed multiple times with following message&amp;nbsp;&lt;/DIV&gt;&lt;DIV&gt;&amp;nbsp;&lt;/DIV&gt;&lt;DIV&gt;&amp;nbsp; &amp;nbsp;&lt;PRE&gt;Task attempt_201404090636_336528_m_000112_0 failed to report status for 600 seconds. Killing!
Task attempt_201404090636_336528_m_000112_1 failed to report status for 600 seconds. Killing!
Task attempt_201404090636_336528_m_000112_2 failed to report status for 600 seconds. Killing!&lt;/PRE&gt;&lt;/DIV&gt;&lt;DIV&gt;&lt;DIV&gt;&amp;nbsp;&lt;/DIV&gt;&lt;/DIV&gt;&lt;DIV&gt;I was trying to distcp directory which has about ~1200 files with size 3MB - 5MB&lt;/DIV&gt;&lt;DIV&gt;&amp;nbsp;&lt;/DIV&gt;&lt;DIV&gt;We have 80 datanodes in the cluster.&lt;/DIV&gt;&lt;DIV&gt;&amp;nbsp;&lt;/DIV&gt;&lt;DIV&gt;&amp;nbsp;&lt;/DIV&gt;&lt;DIV&gt;Any help here with this please.&lt;/DIV&gt;&lt;DIV&gt;&amp;nbsp;&lt;/DIV&gt;&lt;DIV&gt;Thanks&lt;/DIV&gt;&lt;DIV&gt;roy&lt;/DIV&gt;&lt;/DIV&gt;&lt;DIV&gt;&amp;nbsp;&lt;/DIV&gt;&lt;DIV&gt;&amp;nbsp;&lt;/DIV&gt;&lt;/DIV&gt;&lt;DIV&gt;&amp;nbsp;&lt;/DIV&gt;&lt;DIV class="IVILX2C-tb-b"&gt;&lt;DIV class="IVILX2C-tb-a IVILX2C-tb-cb"&gt;&lt;DIV&gt;&lt;DIV&gt;&amp;nbsp;&lt;/DIV&gt;&lt;DIV class="IVILX2C-nd-a"&gt;&amp;nbsp;&lt;/DIV&gt;&lt;/DIV&gt;&lt;/DIV&gt;&lt;/DIV&gt;</description>
      <pubDate>Fri, 16 Sep 2022 09:57:03 GMT</pubDate>
      <guid>https://community.cloudera.com/t5/Archives-of-Support-Questions/distcp-on-cdh3u5-failing-with-timeout-error/m-p/36202#M14870</guid>
      <dc:creator>Roy</dc:creator>
      <dc:date>2022-09-16T09:57:03Z</dc:date>
    </item>
    <item>
      <title>Re: distcp on cdh3u5 failing with timeout error</title>
      <link>https://community.cloudera.com/t5/Archives-of-Support-Questions/distcp-on-cdh3u5-failing-with-timeout-error/m-p/36234#M14871</link>
      <description>&lt;P&gt;&lt;SPAN&gt;looks like its working after addition of&amp;nbsp;-D mapred.task.timeout=60000000&lt;/SPAN&gt;&lt;/P&gt;</description>
      <pubDate>Thu, 14 Jan 2016 13:56:44 GMT</pubDate>
      <guid>https://community.cloudera.com/t5/Archives-of-Support-Questions/distcp-on-cdh3u5-failing-with-timeout-error/m-p/36234#M14871</guid>
      <dc:creator>Roy</dc:creator>
      <dc:date>2016-01-14T13:56:44Z</dc:date>
    </item>
  </channel>
</rss>

