question CDS Workbench with Spark Versions Below 2.0 in Support Questions

CDS Workbench with Spark Versions Below 2.0

mdnickens — Fri, 16 Sep 2022 12:30:45 GMT

Hello,

Does CDS Workbench work alongside versions of Spark below 2.0? We're running 1.6.0 and would like to add CDSW. We're upgrading to 2.2 eventually, but we'd like to test drive the workbench beforehand.

Thanks!

Re: CDS Workbench with Spark Versions Below 2.0

srowen — Mon, 13 Nov 2017 19:14:27 GMT

No, it requires Spark 2.

Re: CDS Workbench with Spark Versions Below 2.0

tristanzajonc — Mon, 13 Nov 2017 19:52:37 GMT

Cloudera Data Science Workbench only supports Spark 2.x, it doesn't support
the Spark 1.x line. Spark 2 has a number of important improvements for
data science workloads which is why we have focused on Spark 2 support
only. You can still use Spark 1.x on the same cluster, but only Spark 2
within CDSW.

Best,
Tristan

Re: CDS Workbench with Spark Versions Below 2.0

mdnickens — Mon, 13 Nov 2017 22:06:17 GMT

Thank you both for the quick replies!