question Re: Is Scala 2.11 compitable with HDP2.3.4? in Archives of Support Questions (Read Only)

Is Scala 2.11 compitable with HDP2.3.4?

divakarreddy_a — Fri, 29 Apr 2016 10:55:39 GMT

Currently we are using HDP2.3.4 with Spark1.5.2 and Scala 2.10.

Can we upgrade Scala 2.11 without upgrading Spark and HDP?

Thanks for your help!

ravi1 — Fri, 29 Apr 2016 11:13:01 GMT

No. You will at the least need to build spark for 2.11. From spark apache documentation,

To produce a Spark package compiled with Scala 2.11, use the -Dscala-2.11 property:

./dev/change-scala-version.sh 2.11
mvn -Pyarn -Phadoop-2.4 -Dscala-2.11 -DskipTests clean package

Spark does not yet support its JDBC component for Scala 2.11.

divakarreddy_a — Fri, 29 Apr 2016 11:42:49 GMT

Thanks for quick response.

TimothySpann — Thu, 24 Nov 2016 00:39:25 GMT

how about for HDP 2.5