Support Questions

Find answers, ask questions, and share your expertise

CDH6 run mr wrong

avatar
New Contributor

Failed to download resource { { hdfs://nameservice1/user/yarn/mapreduce/mr-framework/3.0.0-cdh6.0.0-mr-framework.tar.gz, 1537161400019, ARCHIVE, null },pending,[(container_1540371645308_0001_01_000001)],3447382585916584,DOWNLOADING}
org.apache.hadoop.yarn.exceptions.YarnException: Download and unpack failed
at org.apache.hadoop.yarn.util.FSDownload.downloadAndUnpack(FSDownload.java:306)
at org.apache.hadoop.yarn.util.FSDownload.verifyAndCopy(FSDownload.java:283)
at org.apache.hadoop.yarn.util.FSDownload.call(FSDownload.java:409)
at org.apache.hadoop.yarn.util.FSDownload.call(FSDownload.java:66)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.io.IOException: Error executing command. gzip -dc | (cd '/data1/yarn/nm/filecache/10_tmp/3.0.0-cdh6.0.0-mr-framework.tar.gz' && tar -x ) Process exited with exit code 2.
at org.apache.hadoop.fs.FileUtil.runCommandOnStream(FileUtil.java:785)
at org.apache.hadoop.fs.FileUtil.unTarUsingTar(FileUtil.java:871)
at org.apache.hadoop.fs.FileUtil.unTar(FileUtil.java:822)
at org.apache.hadoop.yarn.util.FSDownload.unpack(FSDownload.java:339)
at org.apache.hadoop.yarn.util.FSDownload.downloadAndUnpack(FSDownload.java:303)
... 9 more

1 ACCEPTED SOLUTION

avatar
Guru

@balkrishna ,

 

I wonder if you have upgraded or applied any patches before you notice the issue? 

 

There is a new action - Install YARN MapReduce Framework JARs added under YARN service in Cloudera Manager. Each (rolling) upgrade or patch application requires a re-run of the the action to install a new archive (compressed tar). It will not happen automatically as part of the upgrade or patch.

 

You may want to give that a try:

CM->Yarn->Actions->Click on "Install YARN MapReduce Framework JARs".

 

Thanks and hope this helps,

Li

Li Wang, Technical Solution Manager


Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.

Learn more about the Cloudera Community:

Terms of Service

Community Guidelines

How to use the forum

View solution in original post

4 REPLIES 4

avatar
New Contributor

We encountering , exact same issue on CDH 6.2, can anyone provide the solution please

avatar
Guru

@balkrishna ,

 

I wonder if you have upgraded or applied any patches before you notice the issue? 

 

There is a new action - Install YARN MapReduce Framework JARs added under YARN service in Cloudera Manager. Each (rolling) upgrade or patch application requires a re-run of the the action to install a new archive (compressed tar). It will not happen automatically as part of the upgrade or patch.

 

You may want to give that a try:

CM->Yarn->Actions->Click on "Install YARN MapReduce Framework JARs".

 

Thanks and hope this helps,

Li

Li Wang, Technical Solution Manager


Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.

Learn more about the Cloudera Community:

Terms of Service

Community Guidelines

How to use the forum

avatar
New Contributor
thanks, this resolved our issue, how do i mark it as a solution? i do not see any option

avatar
Guru

Hi @balkrishna ,

 

Great to hear that the issue got resolved! As for marking of a solution, only the author of the topic/question can mark a reply as the solution. I will however mark this as resolved for you since it is fixed now.

 

Thanks for using our community!

Li

Li Wang, Technical Solution Manager


Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.

Learn more about the Cloudera Community:

Terms of Service

Community Guidelines

How to use the forum