chriswalton
chriswalton
New Contributor

Re: Spark 2.3 with Cloduera Version 6?

by New Contributor chriswalton in Support Questions
‎11-09-2018 05:42 AM
‎11-09-2018 05:42 AM
Thank you for the claftiaftion.  Saved me a world of pain. it's not very clear from the "Upgrading Spark" page that you cannot complete the upgrade when using version 6. https://www.cloudera.com/documentation/spark2/latest/topics/spark2_packaging.html Thanks again. ... View more

Spark 2.3 with Cloduera Version 6?

by New Contributor chriswalton in Support Questions
‎11-09-2018 04:07 AM
‎11-09-2018 04:07 AM
Hi, I'm currently CDH 5.14 with Spark2, which uses the Spark CDS 2.3 (release 4). I plan on upgrading to Cloudera Version 6, which I know uses CDS 2.2.  It's my understanding that before the upgrade I will need to remove Spark 2 via Cloduera Manager  " If you are using a  CDS 2  minor version higher than the version of Spark 2 included in the CDH 6 release you are upgrading to ( 2.2 in CDH 6.0.0 ), you must remove your Spark 2 services from Cloudera Manager." https://www.cloudera.com/documentation/enterprise/upgrade/topics/ug_spark_standalone.html#concept_alc_wpl_x2b As part of the upgrade, Spark2 CDS 2.2 would be installed.  At this point am I able to then re download the Service Descriptor for 2.3 (release 4) and upgrade to that? ... View more
Contact Me
Online
Offline
Last Visited
‎12-04-2018 12:42 AM
Public Statistics
Date Registered ‎10-16-2018 02:12 AM
Last Visited ‎12-04-2018 12:42 AM
Total Messages Posted 2