- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Failed to deploy Spark on CDH-5.3.0
Created on ‎01-04-2015 12:53 AM - edited ‎09-16-2022 02:17 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
CDH 5.3.0, unable to add Spark service, the webui display 'SparkUploadJarServiceCommand failed'.
check log file, found error as follows,
[Cannot find the assembly on local filesystem: /opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/spark/assembly/lib/spark-assembly*cdh*.jar]
To view the local filesystem, the Jar file does not exists indeed.
CDH5.2.x has no this problem cause the Jar file exists.
Created ‎01-04-2015 03:58 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
guide to move to v5.3.0.
http://www.cloudera.com/content/cloudera/en/documentation/core/latest/topics/cm_ag_upgrade_cm5.html
Gautam Gopalakrishnan
Created ‎01-04-2015 01:08 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
than 5.3.0 to manage a CDH 5.3.0 cluster. Please upgrade Cloudera Manager
as well to 5.3.0. If the error still persists, then run the following
commands to fix the symlink.
$ sudo mkdir -p -m 755 /opt/cloudera/parcels/CDH/lib/spark/assembly/lib
$ sudo ln -sf
/opt/cloudera/parcels/CDH/lib/spark/lib/spark-assembly-1.2.0-cdh5.3.0-hadoop2.5.0-cdh5.3.0.jar
/opt/cloudera/parcels/CDH/lib/spark/assembly/lib/spark-assembly-1.2.0-cdh5.3.0-hadoop2.5.0-cdh5.3.0.jar
Gautam Gopalakrishnan
Created ‎01-04-2015 01:21 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
You're totally right, thanks!
Created ‎01-04-2015 03:49 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
http://archive.cloudera.com/cm5/installer/5.2.1
http://archive.cloudera.com/cm5/installer/5.3.0
I download cm5 (v5.2.1 & v5.3.0) from above url,
however, I found the version is still v5.2.0 when I installed it.
Created ‎01-04-2015 03:58 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
guide to move to v5.3.0.
http://www.cloudera.com/content/cloudera/en/documentation/core/latest/topics/cm_ag_upgrade_cm5.html
Gautam Gopalakrishnan
Created ‎01-04-2015 04:11 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Thanks for your prompt reply. I'll try it.
