Support Questions
Find answers, ask questions, and share your expertise

Can I upgrade Apache Spark when I'm using packages?

Explorer

Hi Right now I'm using Parcels, but if I wanted to upgrade to pacakges (or migrate to packages rather) then could I upgrade to Apache Spark 2.0.2?  Could I still use Cloudera Maanger to control it?

 

 

 

1 ACCEPTED SOLUTION

Accepted Solutions

Expert Contributor

Spark 2.0 is available as a parcel as well, so you shouldn't need to move to packages unless you have another reason.  Spark 2.0 is out of beta now and is GA.  Here is more information on how to install Spark 2 with Cloudera Manager: http://www.cloudera.com/documentation/spark2/latest/topics/spark2_installing.html

View solution in original post

5 REPLIES 5

Explorer

There isn't even a working link that takes me to the "Spark 2.0 Beta" either. http://www.cloudera.com/downloads/beta/spark2/2-0-0.html

Expert Contributor

Spark 2.0 is available as a parcel as well, so you shouldn't need to move to packages unless you have another reason.  Spark 2.0 is out of beta now and is GA.  Here is more information on how to install Spark 2 with Cloudera Manager: http://www.cloudera.com/documentation/spark2/latest/topics/spark2_installing.html

View solution in original post

Explorer

Hey man thanks for link but that's for CDH 5.7.  Can you tell me if that will have a problem with CDH 5.9?  I don't have CDH 5.7, and I'm not going to try and revert to an old version. 

Explorer

 

I installed my cluster (CDH 5.10.0) using packages. I would like to try Spark2, but noticed it is currently only available as a parcel. I can't find any instructions for my situation. So my question is: is it possible to install the Spark2 parcel on my cluster, even though my cluster was originally installed by using packages?

 

Expert Contributor
No problem. The name is a bit misleading, but 5.7 is the minimum version required, installing that parcel won't be a problem with 5.9. the requirements section[1] has a bit more information on supported versions.

1. http://www.cloudera.com/documentation/spark2/latest/topics/spark2_requirements.html