<?xml version="1.0" encoding="UTF-8"?>
<rss xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:taxo="http://purl.org/rss/1.0/modules/taxonomy/" version="2.0">
  <channel>
    <title>question MapReduce Job stuck in Reduce Phase in Support Questions</title>
    <link>https://community.cloudera.com/t5/Support-Questions/MapReduce-Job-stuck-in-Reduce-Phase/m-p/25645#M34980</link>
    <description>&lt;P&gt;Hello all,&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;I've installed a new cluster using managed installation of cdh 5 with 7 dedicated and hardware specific machines. The installation was succesful and all health tests have been passed succesfully.&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;Also I've tested that the network is fully operational, all ports can be accessed and the DNS is responding both direct and reverse.&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;My problem raises when I try to run a Hadoop application from the command line, I know that this must be a configuration error as I have ran the same JAR in an Amazon EMR machine without problems many times.&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;The problem is that hadoop get stuck when a certain step of the reduce phase is reached. No matter how many reduce tasks I configure for the job (from 1 to N), I can see in the application master that the running tasks are always in the same state:&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;&lt;STRONG&gt;28.13% RUNNING reduce &amp;gt; copy(27 of 32 at 1.30 MB/s)&lt;/STRONG&gt;&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;The systems seems not to have any traffic at all, but if let them run indefinitely the program finishes ans the results are ok, but in almost a 1000% of the usual required time. In addition, several errors are raised:&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;&lt;STRONG&gt;shuffle error:exceeded max_failed_unique_matche : bailing out&lt;/STRONG&gt;&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;I've seen googling around that this seems to be a common problem in many hadoop installations, but I've checked everything in the configuration witout success. I would really appreciate it if anyone could point me in another direction. Please do not hesitate to request any additional information or logs.&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;Cheers&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;</description>
    <pubDate>Fri, 16 Sep 2022 09:24:30 GMT</pubDate>
    <dc:creator>JacintoArias</dc:creator>
    <dc:date>2022-09-16T09:24:30Z</dc:date>
  </channel>
</rss>

