Support Questions

Find answers, ask questions, and share your expertise
Announcements
Welcome to the upgraded Community! Read this blog to see What’s New!

Hortonworks and Spark 2.0

avatar
Expert Contributor

According to the Databricks people at the Spark Summit 2016 in New York, Spark 2.0 is coming out in April/May this year. This means a "jump" from 1.6.0 to 2.0.

Spark 1.5.2 is installed with the latest Hortonworks distribution. Spark 1.6.0 is in technical preview, Spark 2.0 is around the corner. Im wondering what plans Hortonworks has around this matter?

1 ACCEPTED SOLUTION

avatar

Hi @marko, if I remember correctly Spark-1.6 TP for HDP-2.3.4 was announced 1 day after its GA. Therefore, you can expect Spark-2.0 TP with about the same "delay", and its inclusion in one of the coming versions of HDP soon after. Stay tuned!

View solution in original post

6 REPLIES 6

avatar

Hi @marko, if I remember correctly Spark-1.6 TP for HDP-2.3.4 was announced 1 day after its GA. Therefore, you can expect Spark-2.0 TP with about the same "delay", and its inclusion in one of the coming versions of HDP soon after. Stay tuned!

avatar

avatar
Mentor

No plans have been announced but we can guess around the same time as Apache stable release, so maybe when 2.0.1 lands.

avatar

With HDP 2.4 release, we now support Spark 1.6.

avatar
Rising Star

any guides to upgrade spark from 1.6.1 to 1.6.2 we are on the HDP 2.4.

avatar
New Contributor

I'd like to upgrade my hortonworks 2.4.0.0-169 cluster to run Spark 2.0 now on GA to trial it, How to upgrade?

Labels