question Uprade spark 0.9 to latest using Cloudera manager (5.0.2) in Archives of Support Questions (Read Only)

Uprade spark 0.9 to latest using Cloudera manager (5.0.2)

sathishaptude — Fri, 16 Sep 2022 09:23:04 GMT

Hi all,

I have installed CDH( 5.0.2) using cloudera manager 5.0.2 by chosing parcels.

Spark 0.9.0+cdh5.0.2+36 version has come with it.

Now I need to upgrade only Spark to latest version 1.1.x or 1.2.x.

I have seen ways to do it using cloudera manager parcels but when i click on 'check for new parcels' it just shows older one (0.9.0-1.cdh4.6.0.p0.98).

Is there a way I can upgrade only spark or I need to upgrade complete CDH (5.3.2-1.cdh5.3.2.p0.10) to get latest spark.

Please help me It is urgent.

Thanks,

Sathish.

Re: Uprade spark 0.9 to latest using Cloudera manager (5.0.2)

Clint — Mon, 02 Mar 2015 20:52:08 GMT

I believe you will need to at least upgrade Cloudera Manager to the latest version (5.3.2) before it will offer you the opportunity to download newer Spark parcels. FWIW, the latest CM version should be able to install/manage up to Spark 1.2.0.

I will defer to the experts about whether you can only update Spark and not the rest of the CDH stack...

Re: Uprade spark 0.9 to latest using Cloudera manager (5.0.2)

sathishaptude — Tue, 03 Mar 2015 05:50:20 GMT

Cloudera documentation also mentions about

yum install spark*....

Can I do it to upgrade spark even if I installed it through cloudera manager ? or that way is only for non cloudera manager installation only ?

Re: Uprade spark 0.9 to latest using Cloudera manager (5.0.2)

Clint — Thu, 05 Mar 2015 19:11:29 GMT

The instructions to use Yum would only be for non-parcel and non-Cloudera Manager installations. When using Cloudera Manager, and in particular our "parcels" packaging format, you need to do upgrades through Cloudera Manager only.

This doc explains the differences between the packages that yum can handle and how we incorporate parcels.

Re: Uprade spark 0.9 to latest using Cloudera manager (5.0.2)

morfious902002 — Fri, 20 Mar 2015 02:52:53 GMT

Apache just released 1.3.0 and I would like to install that on my CDH cluster. I know it will added to 5.4 CDH release but is there any other way to get it now? Or any other way to upgrade the existing SPARK standalone installation from 1.2.0 to 1.3.0.