Support Questions

Find answers, ask questions, and share your expertise

Spark 2.0 still TP?

avatar
Contributor

Hello,

I'm installing hdp and Ambari ask me to choose the services which I want to install. I see, that Spark 2.0 is still marked as Technical Preview. Is this correct?

I want to use it for my study, so sould I install Spark, Spark 2.0, or Spark+Spark2.0? I prefer Spark 2.0, but I'm not sure if it is stable enough and if not, can I install both at the same time without any problem?

Best regards

1 ACCEPTED SOLUTION

avatar
Expert Contributor

With the latest version of HDP - 2.5.3, you can install Spark 1.6.2 (GA and stable), as well as Spark 2.0.1 (Tech Preview).

http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.3/bk_release-notes/content/ch_relnotes_v253.ht...

The install via Ambari, will create two separate Spark environments on the cluster.

You can access different Spark versions as detailed in:

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.0/bk_spark-component-guide/content/spark-choo...

Regards

View solution in original post

3 REPLIES 3

avatar
Expert Contributor

With the latest version of HDP - 2.5.3, you can install Spark 1.6.2 (GA and stable), as well as Spark 2.0.1 (Tech Preview).

http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.3/bk_release-notes/content/ch_relnotes_v253.ht...

The install via Ambari, will create two separate Spark environments on the cluster.

You can access different Spark versions as detailed in:

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.0/bk_spark-component-guide/content/spark-choo...

Regards

avatar
@Jan Horton

Yes, you can install both at the same time without any problem.

Spark 2.0 is TP as of HDP 2.5.3 and not recommended for production use, however you are welcome to use it for study.

avatar
Contributor

Thank you very much. I installed both and it works fine.