https://community.cloudera.com/t5/Support-Questions/hive-testbench-shuffle-error-when-running-tpch-setup/m-p/301585#M220755 <P>The issue could be associated with the c<SPAN>orrupt permissions in NM local-dir (usercache) are causing the shuffle fetch failure which may occur due to the below reasons,</SPAN></P><P>&nbsp;</P><P><SPAN>1.</SPAN><SPAN>Disk failure cause the fetch failure</SPAN></P><P><SPAN>2.&nbsp;Network issue causes the fetch failure</SPAN></P><P>&nbsp;</P><P><SPAN>This can be overcome by carrying out the below steps in the NodeManger installed nodes.</SPAN></P><P>&nbsp;</P><P><SPAN>* Stop the NM instance on the node<BR />* Remove YARN NM local-dir path<BR />- sudo rm -rf /JBOD_D${i}/hadoop/cdh/yarn/nm/*" where ${i} is the iteration over the disks that each participate as NM local-dir storage<BR />- the idea is to leave /JBOD_D${i}/hadoop/cdh/yarn/nm in place on each disk, but remove everything below that point.<BR />* Restart the NM instance and it will recreate the structure with the appropriate permissions.</SPAN></P><P>&nbsp;</P><P>Once you have implemented the above solution and if it continues to&nbsp; working well, then please spare few minutes to hit the "Accept as Solution"</P><P>&nbsp;</P> Mon, 17 Aug 2020 08:50:14 GMT Krishnadevan 2020-08-17T08:50:14Z