Created 09-01-2020 01:03 AM
Hi Cloudera Community,
I am currently using spark1.6 version on cdh5.16.1. Now I have a requirement to upgrade spark from 1.6 to 2.3. So, I want to know which cdh version meets my requirement.
Created 09-01-2020 04:17 AM
Spark 2.3 (or 2.4) can run along side Spark 1.6 on 5.16. It installs as a separate parcel.
See https://docs.cloudera.com/documentation/spark2/2-3-x/topics/spark2.html
Created 09-01-2020 04:17 AM
Spark 2.3 (or 2.4) can run along side Spark 1.6 on 5.16. It installs as a separate parcel.
See https://docs.cloudera.com/documentation/spark2/2-3-x/topics/spark2.html
Created 09-03-2020 07:22 PM
Hi Mike,
I went through the doc, it clearly says we can have spark 2.3 on my version of cdh, but lacks the steps of installation. I am new to cdh setup and hence request you to provide the steps if available, so that it helps me setup my cluster.
Thanks & Regards,
Srinivas
Created 09-05-2020 01:28 PM
It's a few links down on the page I sent...
https://docs.cloudera.com/documentation/spark2/2-3-x/topics/spark2_installing.html