Reply
Highlighted
Explorer
Posts: 15
Registered: ‎06-10-2016
Accepted Solution

Can I upgrade Apache Spark when I'm using packages?

Hi Right now I'm using Parcels, but if I wanted to upgrade to pacakges (or migrate to packages rather) then could I upgrade to Apache Spark 2.0.2?  Could I still use Cloudera Maanger to control it?

 

 

 

Explorer
Posts: 15
Registered: ‎06-10-2016

Re: Can I upgrade Apache Spark when I'm using packages?

There isn't even a working link that takes me to the "Spark 2.0 Beta" either. http://www.cloudera.com/downloads/beta/spark2/2-0-0.html

Cloudera Employee
Posts: 94
Registered: ‎05-10-2016

Re: Can I upgrade Apache Spark when I'm using packages?

Spark 2.0 is available as a parcel as well, so you shouldn't need to move to packages unless you have another reason.  Spark 2.0 is out of beta now and is GA.  Here is more information on how to install Spark 2 with Cloudera Manager: http://www.cloudera.com/documentation/spark2/latest/topics/spark2_installing.html

Explorer
Posts: 15
Registered: ‎06-10-2016

Re: Can I upgrade Apache Spark when I'm using packages?

Hey man thanks for link but that's for CDH 5.7.  Can you tell me if that will have a problem with CDH 5.9?  I don't have CDH 5.7, and I'm not going to try and revert to an old version. 

Cloudera Employee
Posts: 94
Registered: ‎05-10-2016

Re: Can I upgrade Apache Spark when I'm using packages?

No problem. The name is a bit misleading, but 5.7 is the minimum version required, installing that parcel won't be a problem with 5.9. the requirements section[1] has a bit more information on supported versions.

1. http://www.cloudera.com/documentation/spark2/latest/topics/spark2_requirements.html
Explorer
Posts: 16
Registered: ‎06-25-2014

Re: Can I upgrade Apache Spark when I'm using packages?

 

I installed my cluster (CDH 5.10.0) using packages. I would like to try Spark2, but noticed it is currently only available as a parcel. I can't find any instructions for my situation. So my question is: is it possible to install the Spark2 parcel on my cluster, even though my cluster was originally installed by using packages?

 

Announcements