Support Questions

Find answers, ask questions, and share your expertise

apache spark 2.0

avatar
Super Collaborator

I am using HDP 2.4 , and spark 1.6.2 .

I need to upgrade my spark to v2.0 , can it be done in HDP2.4 ? if not then can I install two releases of spark together on the same machine?

1 ACCEPTED SOLUTION

avatar
Super Collaborator

@Sami Ahmad, in terms of supported configurations, Spark versions 1.6.2 and 2.0 (in technical preview) can be installed together on HDP 2.5.0. See the following for more info:

http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.0/bk_spark-component-guide/content/install-spa....

View solution in original post

2 REPLIES 2

avatar

I know of at least one customer who is running two Spark releases on the same cluster. However it is not officially supported until HDP version 2.5.

avatar
Super Collaborator

@Sami Ahmad, in terms of supported configurations, Spark versions 1.6.2 and 2.0 (in technical preview) can be installed together on HDP 2.5.0. See the following for more info:

http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.0/bk_spark-component-guide/content/install-spa....