Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Is Scala 2.11 compitable with HDP2.3.4?

avatar

Currently we are using HDP2.3.4 with Spark1.5.2 and Scala 2.10.

Can we upgrade Scala 2.11 without upgrading Spark and HDP?

Thanks for your help!

1 ACCEPTED SOLUTION

avatar
Guru

No. You will at the least need to build spark for 2.11. From spark apache documentation,

To produce a Spark package compiled with Scala 2.11, use the -Dscala-2.11 property:

./dev/change-scala-version.sh 2.11
mvn -Pyarn -Phadoop-2.4 -Dscala-2.11 -DskipTests clean package 

Spark does not yet support its JDBC component for Scala 2.11.

View solution in original post

3 REPLIES 3

avatar
Guru

No. You will at the least need to build spark for 2.11. From spark apache documentation,

To produce a Spark package compiled with Scala 2.11, use the -Dscala-2.11 property:

./dev/change-scala-version.sh 2.11
mvn -Pyarn -Phadoop-2.4 -Dscala-2.11 -DskipTests clean package 

Spark does not yet support its JDBC component for Scala 2.11.

avatar

Thanks for quick response.

avatar
Master Guru

how about for HDP 2.5