Support Questions
Find answers, ask questions, and share your expertise

Is Scala 2.11 compitable with HDP2.3.4?

Currently we are using HDP2.3.4 with Spark1.5.2 and Scala 2.10.

Can we upgrade Scala 2.11 without upgrading Spark and HDP?

Thanks for your help!

1 ACCEPTED SOLUTION

Accepted Solutions

Guru

No. You will at the least need to build spark for 2.11. From spark apache documentation,

To produce a Spark package compiled with Scala 2.11, use the -Dscala-2.11 property:

./dev/change-scala-version.sh 2.11
mvn -Pyarn -Phadoop-2.4 -Dscala-2.11 -DskipTests clean package 

Spark does not yet support its JDBC component for Scala 2.11.

View solution in original post

3 REPLIES 3

Guru

No. You will at the least need to build spark for 2.11. From spark apache documentation,

To produce a Spark package compiled with Scala 2.11, use the -Dscala-2.11 property:

./dev/change-scala-version.sh 2.11
mvn -Pyarn -Phadoop-2.4 -Dscala-2.11 -DskipTests clean package 

Spark does not yet support its JDBC component for Scala 2.11.

View solution in original post

Thanks for quick response.

Super Guru

how about for HDP 2.5