Reply
New Contributor
Posts: 2
Registered: ‎11-13-2017
Accepted Solution

CDS Workbench with Spark Versions Below 2.0

Hello,

 

Does CDS Workbench work alongside versions of Spark below 2.0?  We're running 1.6.0 and would like to add CDSW.  We're upgrading to 2.2 eventually, but we'd like to test drive the workbench beforehand.

 

Thanks!

Cloudera Employee
Posts: 461
Registered: ‎08-11-2014

Re: CDS Workbench with Spark Versions Below 2.0

No, it requires Spark 2.

Cloudera Employee
Posts: 31
Registered: ‎04-28-2017

Re: CDS Workbench with Spark Versions Below 2.0

Cloudera Data Science Workbench only supports Spark 2.x, it doesn't support
the Spark 1.x line. Spark 2 has a number of important improvements for
data science workloads which is why we have focused on Spark 2 support
only. You can still use Spark 1.x on the same cluster, but only Spark 2
within CDSW.

Best,
Tristan
Highlighted
New Contributor
Posts: 2
Registered: ‎11-13-2017

Re: CDS Workbench with Spark Versions Below 2.0

Thank you both for the quick replies!

Announcements