question CDH6 run mr wrong in Archives of Support Questions (Read Only)

CDH6 run mr wrong

punyreborn — Thu, 27 Jun 2019 14:17:05 GMT

Failed to download resource { { hdfs://nameservice1/user/yarn/mapreduce/mr-framework/3.0.0-cdh6.0.0-mr-framework.tar.gz, 1537161400019, ARCHIVE, null },pending,[(container_1540371645308_0001_01_000001)],3447382585916584,DOWNLOADING}
org.apache.hadoop.yarn.exceptions.YarnException: Download and unpack failed
at org.apache.hadoop.yarn.util.FSDownload.downloadAndUnpack(FSDownload.java:306)
at org.apache.hadoop.yarn.util.FSDownload.verifyAndCopy(FSDownload.java:283)
at org.apache.hadoop.yarn.util.FSDownload.call(FSDownload.java:409)
at org.apache.hadoop.yarn.util.FSDownload.call(FSDownload.java:66)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.io.IOException: Error executing command. gzip -dc | (cd '/data1/yarn/nm/filecache/10_tmp/3.0.0-cdh6.0.0-mr-framework.tar.gz' && tar -x ) Process exited with exit code 2.
at org.apache.hadoop.fs.FileUtil.runCommandOnStream(FileUtil.java:785)
at org.apache.hadoop.fs.FileUtil.unTarUsingTar(FileUtil.java:871)
at org.apache.hadoop.fs.FileUtil.unTar(FileUtil.java:822)
at org.apache.hadoop.yarn.util.FSDownload.unpack(FSDownload.java:339)
at org.apache.hadoop.yarn.util.FSDownload.downloadAndUnpack(FSDownload.java:303)
... 9 more

Re: CDH6 run mr wrong

balkrishna — Wed, 26 Jun 2019 12:33:40 GMT

We encountering , exact same issue on CDH 6.2, can anyone provide the solution please

Re: CDH6 run mr wrong

lwang — Thu, 27 Jun 2019 05:56:21 GMT

@balkrishna ,

I wonder if you have upgraded or applied any patches before you notice the issue?

There is a new action - Install YARN MapReduce Framework JARs added under YARN service in Cloudera Manager. Each (rolling) upgrade or patch application requires a re-run of the the action to install a new archive (compressed tar). It will not happen automatically as part of the upgrade or patch.

You may want to give that a try:

CM->Yarn->Actions->Click on "Install YARN MapReduce Framework JARs".

Thanks and hope this helps,

Re: CDH6 run mr wrong

balkrishna — Fri, 28 Jun 2019 10:42:05 GMT

thanks, this resolved our issue, how do i mark it as a solution? i do not see any option

Re: CDH6 run mr wrong

lwang — Fri, 28 Jun 2019 17:53:04 GMT

Hi @balkrishna ,

Great to hear that the issue got resolved! As for marking of a solution, only the author of the topic/question can mark a reply as the solution. I will however mark this as resolved for you since it is fixed now.

Thanks for using our community!