Created on 10-24-2018 03:14 AM - last edited on 06-27-2019 07:17 AM by cjervis
Failed to download resource { { hdfs://nameservice1/user/yarn/mapreduce/mr-framework/3.0.0-cdh6.0.0-mr-framework.tar.gz, 1537161400019, ARCHIVE, null },pending,[(container_1540371645308_0001_01_000001)],3447382585916584,DOWNLOADING}
org.apache.hadoop.yarn.exceptions.YarnException: Download and unpack failed
at org.apache.hadoop.yarn.util.FSDownload.downloadAndUnpack(FSDownload.java:306)
at org.apache.hadoop.yarn.util.FSDownload.verifyAndCopy(FSDownload.java:283)
at org.apache.hadoop.yarn.util.FSDownload.call(FSDownload.java:409)
at org.apache.hadoop.yarn.util.FSDownload.call(FSDownload.java:66)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.io.IOException: Error executing command. gzip -dc | (cd '/data1/yarn/nm/filecache/10_tmp/3.0.0-cdh6.0.0-mr-framework.tar.gz' && tar -x ) Process exited with exit code 2.
at org.apache.hadoop.fs.FileUtil.runCommandOnStream(FileUtil.java:785)
at org.apache.hadoop.fs.FileUtil.unTarUsingTar(FileUtil.java:871)
at org.apache.hadoop.fs.FileUtil.unTar(FileUtil.java:822)
at org.apache.hadoop.yarn.util.FSDownload.unpack(FSDownload.java:339)
at org.apache.hadoop.yarn.util.FSDownload.downloadAndUnpack(FSDownload.java:303)
... 9 more
Created 06-26-2019 10:56 PM
I wonder if you have upgraded or applied any patches before you notice the issue?
There is a new action - Install YARN MapReduce Framework JARs added under YARN service in Cloudera Manager. Each (rolling) upgrade or patch application requires a re-run of the the action to install a new archive (compressed tar). It will not happen automatically as part of the upgrade or patch.
You may want to give that a try:
CM->Yarn->Actions->Click on "Install YARN MapReduce Framework JARs".
Thanks and hope this helps,
Li
Li Wang, Technical Solution Manager
Created 06-26-2019 05:33 AM
We encountering , exact same issue on CDH 6.2, can anyone provide the solution please
Created 06-26-2019 10:56 PM
I wonder if you have upgraded or applied any patches before you notice the issue?
There is a new action - Install YARN MapReduce Framework JARs added under YARN service in Cloudera Manager. Each (rolling) upgrade or patch application requires a re-run of the the action to install a new archive (compressed tar). It will not happen automatically as part of the upgrade or patch.
You may want to give that a try:
CM->Yarn->Actions->Click on "Install YARN MapReduce Framework JARs".
Thanks and hope this helps,
Li
Li Wang, Technical Solution Manager
Created on 06-28-2019 03:37 AM - edited 06-28-2019 03:42 AM
Created 06-28-2019 10:53 AM
Hi @balkrishna ,
Great to hear that the issue got resolved! As for marking of a solution, only the author of the topic/question can mark a reply as the solution. I will however mark this as resolved for you since it is fixed now.
Thanks for using our community!
Li
Li Wang, Technical Solution Manager