Reply
Highlighted
New Contributor
Posts: 2
Registered: ‎10-24-2018
Accepted Solution

CDH6 run mr wrong

[ Edited ]

Failed to download resource { { hdfs://nameservice1/user/yarn/mapreduce/mr-framework/3.0.0-cdh6.0.0-mr-framework.tar.gz, 1537161400019, ARCHIVE, null },pending,[(container_1540371645308_0001_01_000001)],3447382585916584,DOWNLOADING}
org.apache.hadoop.yarn.exceptions.YarnException: Download and unpack failed
at org.apache.hadoop.yarn.util.FSDownload.downloadAndUnpack(FSDownload.java:306)
at org.apache.hadoop.yarn.util.FSDownload.verifyAndCopy(FSDownload.java:283)
at org.apache.hadoop.yarn.util.FSDownload.call(FSDownload.java:409)
at org.apache.hadoop.yarn.util.FSDownload.call(FSDownload.java:66)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.io.IOException: Error executing command. gzip -dc | (cd '/data1/yarn/nm/filecache/10_tmp/3.0.0-cdh6.0.0-mr-framework.tar.gz' && tar -x ) Process exited with exit code 2.
at org.apache.hadoop.fs.FileUtil.runCommandOnStream(FileUtil.java:785)
at org.apache.hadoop.fs.FileUtil.unTarUsingTar(FileUtil.java:871)
at org.apache.hadoop.fs.FileUtil.unTar(FileUtil.java:822)
at org.apache.hadoop.yarn.util.FSDownload.unpack(FSDownload.java:339)
at org.apache.hadoop.yarn.util.FSDownload.downloadAndUnpack(FSDownload.java:303)
... 9 more

New Contributor
Posts: 2
Registered: ‎09-18-2018

Re: CDH6 run mr wrong

We encountering , exact same issue on CDH 6.2, can anyone provide the solution please

Posts: 994
Kudos: 31
Solutions: 20
Registered: ‎05-27-2014

Re: CDH6 run mr wrong

@balkrishna ,

 

I wonder if you have upgraded or applied any patches before you notice the issue? 

 

There is a new action - Install YARN MapReduce Framework JARs added under YARN service in Cloudera Manager. Each (rolling) upgrade or patch application requires a re-run of the the action to install a new archive (compressed tar). It will not happen automatically as part of the upgrade or patch.

 

You may want to give that a try:

CM->Yarn->Actions->Click on "Install YARN MapReduce Framework JARs".

 

Thanks and hope this helps,

Li

Li Wang, Technical Resolution Manager


Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.

Learn more about the Cloudera Community:

Terms of Service

Community Guidelines

How to use the forum

New Contributor
Posts: 2
Registered: ‎09-18-2018

Re: CDH6 run mr wrong

[ Edited ]
thanks, this resolved our issue, how do i mark it as a solution? i do not see any option
Posts: 994
Kudos: 31
Solutions: 20
Registered: ‎05-27-2014

Re: CDH6 run mr wrong

Hi @balkrishna ,

 

Great to hear that the issue got resolved! As for marking of a solution, only the author of the topic/question can mark a reply as the solution. I will however mark this as resolved for you since it is fixed now.

 

Thanks for using our community!

Li

Li Wang, Technical Resolution Manager


Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.

Learn more about the Cloudera Community:

Terms of Service

Community Guidelines

How to use the forum