Support Questions

Find answers, ask questions, and share your expertise

Hortonworks and Spark 2.0

avatar
Expert Contributor

According to the Databricks people at the Spark Summit 2016 in New York, Spark 2.0 is coming out in April/May this year. This means a "jump" from 1.6.0 to 2.0.

Spark 1.5.2 is installed with the latest Hortonworks distribution. Spark 1.6.0 is in technical preview, Spark 2.0 is around the corner. Im wondering what plans Hortonworks has around this matter?

1 ACCEPTED SOLUTION

avatar
Master Guru

Hi @marko, if I remember correctly Spark-1.6 TP for HDP-2.3.4 was announced 1 day after its GA. Therefore, you can expect Spark-2.0 TP with about the same "delay", and its inclusion in one of the coming versions of HDP soon after. Stay tuned!

View solution in original post

6 REPLIES 6

avatar
Master Guru

Hi @marko, if I remember correctly Spark-1.6 TP for HDP-2.3.4 was announced 1 day after its GA. Therefore, you can expect Spark-2.0 TP with about the same "delay", and its inclusion in one of the coming versions of HDP soon after. Stay tuned!

avatar
Master Mentor

avatar
Master Mentor

No plans have been announced but we can guess around the same time as Apache stable release, so maybe when 2.0.1 lands.

avatar

With HDP 2.4 release, we now support Spark 1.6.

avatar
Expert Contributor

any guides to upgrade spark from 1.6.1 to 1.6.2 we are on the HDP 2.4.

avatar
New Contributor

I'd like to upgrade my hortonworks 2.4.0.0-169 cluster to run Spark 2.0 now on GA to trial it, How to upgrade?