Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Spark 2.0 still TP?

Solved Go to solution

Spark 2.0 still TP?

Explorer

Hello,

I'm installing hdp and Ambari ask me to choose the services which I want to install. I see, that Spark 2.0 is still marked as Technical Preview. Is this correct?

I want to use it for my study, so sould I install Spark, Spark 2.0, or Spark+Spark2.0? I prefer Spark 2.0, but I'm not sure if it is stable enough and if not, can I install both at the same time without any problem?

Best regards

1 ACCEPTED SOLUTION

Accepted Solutions

Re: Spark 2.0 still TP?

Expert Contributor

With the latest version of HDP - 2.5.3, you can install Spark 1.6.2 (GA and stable), as well as Spark 2.0.1 (Tech Preview).

http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.3/bk_release-notes/content/ch_relnotes_v253.ht...

The install via Ambari, will create two separate Spark environments on the cluster.

You can access different Spark versions as detailed in:

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.0/bk_spark-component-guide/content/spark-choo...

Regards

3 REPLIES 3

Re: Spark 2.0 still TP?

Expert Contributor

With the latest version of HDP - 2.5.3, you can install Spark 1.6.2 (GA and stable), as well as Spark 2.0.1 (Tech Preview).

http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.3/bk_release-notes/content/ch_relnotes_v253.ht...

The install via Ambari, will create two separate Spark environments on the cluster.

You can access different Spark versions as detailed in:

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.0/bk_spark-component-guide/content/spark-choo...

Regards

Re: Spark 2.0 still TP?

@Jan Horton

Yes, you can install both at the same time without any problem.

Spark 2.0 is TP as of HDP 2.5.3 and not recommended for production use, however you are welcome to use it for study.

Re: Spark 2.0 still TP?

Explorer

Thank you very much. I installed both and it works fine.

Don't have an account?
Coming from Hortonworks? Activate your account here