Skip to main content
vasuinecjn
vasuinecjn
Silver ⭐️
September 1, 2020
Solved

spark2.3 compatible cdh version

Hi Cloudera Community,

 

I am currently using spark1.6 version on cdh5.16.1. Now I have a requirement to upgrade spark from 1.6 to 2.3. So, I want to know which cdh version meets my requirement.

Mike in Austin
Mike in AustinAnswer
Gold ⭐️
September 1, 2020

Spark 2.3 (or 2.4) can run along side Spark 1.6 on 5.16.  It installs as a separate parcel.

 

See https://docs.cloudera.com/documentation/spark2/2-3-x/topics/spark2.html

 

View in thread

3 replies

Mike in Austin
Gold ⭐️
Mike in AustinAnswer
Gold ⭐️
September 1, 2020

Spark 2.3 (or 2.4) can run along side Spark 1.6 on 5.16.  It installs as a separate parcel.

 

See https://docs.cloudera.com/documentation/spark2/2-3-x/topics/spark2.html

 

Translate
    vasuinecjn
    vasuinecjnAuthor
    Silver ⭐️
    September 4, 2020

    Hi Mike,

     

    I went through the doc, it clearly says we can have spark 2.3 on my version of cdh, but lacks the steps of installation. I am new to cdh setup and hence request you to provide the steps if available, so that it helps me setup my cluster.

     

    Thanks & Regards,

    Srinivas

    Translate
    Mike in Austin
    Gold ⭐️
    Mike in Austin
    Gold ⭐️
    September 5, 2020

    It's a few links down on the page I sent...

    https://docs.cloudera.com/documentation/spark2/2-3-x/topics/spark2_installing.html

     

    Translate
    Terms & ConditionsAccessibility statement