Support Questions

Find answers, ask questions, and share your expertise

Spark 2.0 still TP?

Explorer

Hello,

I'm installing hdp and Ambari ask me to choose the services which I want to install. I see, that Spark 2.0 is still marked as Technical Preview. Is this correct?

I want to use it for my study, so sould I install Spark, Spark 2.0, or Spark+Spark2.0? I prefer Spark 2.0, but I'm not sure if it is stable enough and if not, can I install both at the same time without any problem?

Best regards

1 ACCEPTED SOLUTION

Expert Contributor

With the latest version of HDP - 2.5.3, you can install Spark 1.6.2 (GA and stable), as well as Spark 2.0.1 (Tech Preview).

http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.3/bk_release-notes/content/ch_relnotes_v253.ht...

The install via Ambari, will create two separate Spark environments on the cluster.

You can access different Spark versions as detailed in:

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.0/bk_spark-component-guide/content/spark-choo...

Regards

View solution in original post

3 REPLIES 3

Expert Contributor

With the latest version of HDP - 2.5.3, you can install Spark 1.6.2 (GA and stable), as well as Spark 2.0.1 (Tech Preview).

http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.3/bk_release-notes/content/ch_relnotes_v253.ht...

The install via Ambari, will create two separate Spark environments on the cluster.

You can access different Spark versions as detailed in:

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.0/bk_spark-component-guide/content/spark-choo...

Regards

@Jan Horton

Yes, you can install both at the same time without any problem.

Spark 2.0 is TP as of HDP 2.5.3 and not recommended for production use, however you are welcome to use it for study.

Explorer

Thank you very much. I installed both and it works fine.