- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
CDH6 run mr wrong
- Labels:
-
Cloudera Manager
-
MapReduce
Created on
10-24-2018
03:14 AM
- last edited on
06-27-2019
07:17 AM
by
cjervis
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Failed to download resource { { hdfs://nameservice1/user/yarn/mapreduce/mr-framework/3.0.0-cdh6.0.0-mr-framework.tar.gz, 1537161400019, ARCHIVE, null },pending,[(container_1540371645308_0001_01_000001)],3447382585916584,DOWNLOADING}
org.apache.hadoop.yarn.exceptions.YarnException: Download and unpack failed
at org.apache.hadoop.yarn.util.FSDownload.downloadAndUnpack(FSDownload.java:306)
at org.apache.hadoop.yarn.util.FSDownload.verifyAndCopy(FSDownload.java:283)
at org.apache.hadoop.yarn.util.FSDownload.call(FSDownload.java:409)
at org.apache.hadoop.yarn.util.FSDownload.call(FSDownload.java:66)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.io.IOException: Error executing command. gzip -dc | (cd '/data1/yarn/nm/filecache/10_tmp/3.0.0-cdh6.0.0-mr-framework.tar.gz' && tar -x ) Process exited with exit code 2.
at org.apache.hadoop.fs.FileUtil.runCommandOnStream(FileUtil.java:785)
at org.apache.hadoop.fs.FileUtil.unTarUsingTar(FileUtil.java:871)
at org.apache.hadoop.fs.FileUtil.unTar(FileUtil.java:822)
at org.apache.hadoop.yarn.util.FSDownload.unpack(FSDownload.java:339)
at org.apache.hadoop.yarn.util.FSDownload.downloadAndUnpack(FSDownload.java:303)
... 9 more
Created 06-26-2019 10:56 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I wonder if you have upgraded or applied any patches before you notice the issue?
There is a new action - Install YARN MapReduce Framework JARs added under YARN service in Cloudera Manager. Each (rolling) upgrade or patch application requires a re-run of the the action to install a new archive (compressed tar). It will not happen automatically as part of the upgrade or patch.
You may want to give that a try:
CM->Yarn->Actions->Click on "Install YARN MapReduce Framework JARs".
Thanks and hope this helps,
Li
Li Wang, Technical Solution Manager
Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.
Learn more about the Cloudera Community:
Created 06-26-2019 05:33 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
We encountering , exact same issue on CDH 6.2, can anyone provide the solution please
Created 06-26-2019 10:56 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I wonder if you have upgraded or applied any patches before you notice the issue?
There is a new action - Install YARN MapReduce Framework JARs added under YARN service in Cloudera Manager. Each (rolling) upgrade or patch application requires a re-run of the the action to install a new archive (compressed tar). It will not happen automatically as part of the upgrade or patch.
You may want to give that a try:
CM->Yarn->Actions->Click on "Install YARN MapReduce Framework JARs".
Thanks and hope this helps,
Li
Li Wang, Technical Solution Manager
Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.
Learn more about the Cloudera Community:
Created on 06-28-2019 03:37 AM - edited 06-28-2019 03:42 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Created 06-28-2019 10:53 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi @balkrishna ,
Great to hear that the issue got resolved! As for marking of a solution, only the author of the topic/question can mark a reply as the solution. I will however mark this as resolved for you since it is fixed now.
Thanks for using our community!
Li
Li Wang, Technical Solution Manager
Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.
Learn more about the Cloudera Community:
