question spark2.3 compatible cdh version in Support Questions

spark2.3 compatible cdh version

vasuinecjn — Tue, 01 Sep 2020 08:03:13 GMT

Hi Cloudera Community,

I am currently using spark1.6 version on cdh5.16.1. Now I have a requirement to upgrade spark from 1.6 to 2.3. So, I want to know which cdh version meets my requirement.

Re: spark2.3 compatible cdh version

Mike in Austin — Tue, 01 Sep 2020 11:17:07 GMT

Spark 2.3 (or 2.4) can run along side Spark 1.6 on 5.16. It installs as a separate parcel.

See https://docs.cloudera.com/documentation/spark2/2-3-x/topics/spark2.html

Re: spark2.3 compatible cdh version

vasuinecjn — Fri, 04 Sep 2020 02:22:04 GMT

Hi Mike,

I went through the doc, it clearly says we can have spark 2.3 on my version of cdh, but lacks the steps of installation. I am new to cdh setup and hence request you to provide the steps if available, so that it helps me setup my cluster.

Thanks & Regards,

Srinivas

Re: spark2.3 compatible cdh version

Mike in Austin — Sat, 05 Sep 2020 20:28:09 GMT

It's a few links down on the page I sent...

https://docs.cloudera.com/documentation/spark2/2-3-x/topics/spark2_installing.html