Archives of Support Questions (Read Only)

This is an archived board for historical reference. Information and links may no longer be available or relevant
Announcements
This board is archived and read-only for historical reference. To ask a new question, please post a new topic on the appropriate active board.

Is Scala 2.11 compitable with HDP2.3.4?

avatar

Currently we are using HDP2.3.4 with Spark1.5.2 and Scala 2.10.

Can we upgrade Scala 2.11 without upgrading Spark and HDP?

Thanks for your help!

1 ACCEPTED SOLUTION

avatar
Guru

No. You will at the least need to build spark for 2.11. From spark apache documentation,

To produce a Spark package compiled with Scala 2.11, use the -Dscala-2.11 property:

./dev/change-scala-version.sh 2.11
mvn -Pyarn -Phadoop-2.4 -Dscala-2.11 -DskipTests clean package 

Spark does not yet support its JDBC component for Scala 2.11.

View solution in original post

3 REPLIES 3

avatar
Guru

No. You will at the least need to build spark for 2.11. From spark apache documentation,

To produce a Spark package compiled with Scala 2.11, use the -Dscala-2.11 property:

./dev/change-scala-version.sh 2.11
mvn -Pyarn -Phadoop-2.4 -Dscala-2.11 -DskipTests clean package 

Spark does not yet support its JDBC component for Scala 2.11.

avatar

Thanks for quick response.

avatar
Master Guru

how about for HDP 2.5