Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]
Created 09-01-2020 01:03 AM
Hi Cloudera Community,
I am currently using spark1.6 version on cdh5.16.1. Now I have a requirement to upgrade spark from 1.6 to 2.3. So, I want to know which cdh version meets my requirement.
Created 09-01-2020 04:17 AM
Spark 2.3 (or 2.4) can run along side Spark 1.6 on 5.16. It installs as a separate parcel.
See https://docs.cloudera.com/documentation/spark2/2-3-x/topics/spark2.html
Created 09-01-2020 04:17 AM
Spark 2.3 (or 2.4) can run along side Spark 1.6 on 5.16. It installs as a separate parcel.
See https://docs.cloudera.com/documentation/spark2/2-3-x/topics/spark2.html
Created 09-03-2020 07:22 PM
Hi Mike,
I went through the doc, it clearly says we can have spark 2.3 on my version of cdh, but lacks the steps of installation. I am new to cdh setup and hence request you to provide the steps if available, so that it helps me setup my cluster.
Thanks & Regards,
Srinivas
Created 09-05-2020 01:28 PM
It's a few links down on the page I sent...
https://docs.cloudera.com/documentation/spark2/2-3-x/topics/spark2_installing.html