question Re: apache spark 2.0 in Archives of Support Questions (Read Only)

apache spark 2.0

aliyesami — Wed, 28 Sep 2016 21:29:13 GMT

I am using HDP 2.4 , and spark 1.6.2 .

I need to upgrade my spark to v2.0 , can it be done in HDP2.4 ? if not then can I install two releases of spark together on the same machine?

Re: apache spark 2.0

Former Member — Wed, 28 Sep 2016 22:11:57 GMT

I know of at least one customer who is running two Spark releases on the same cluster. However it is not officially supported until HDP version 2.5.

Re: apache spark 2.0

lgeorge — Wed, 28 Sep 2016 22:14:50 GMT

@Sami Ahmad, in terms of supported configurations, Spark versions 1.6.2 and 2.0 (in technical preview) can be installed together on HDP 2.5.0. See the following for more info:

http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.0/bk_spark-component-guide/content/install-spark-over-ambari.html.