Created 09-28-2016 02:29 PM
I am using HDP 2.4 , and spark 1.6.2 .
I need to upgrade my spark to v2.0 , can it be done in HDP2.4 ? if not then can I install two releases of spark together on the same machine?
Created 09-28-2016 03:14 PM
@Sami Ahmad, in terms of supported configurations, Spark versions 1.6.2 and 2.0 (in technical preview) can be installed together on HDP 2.5.0. See the following for more info:
Created 09-28-2016 03:11 PM
I know of at least one customer who is running two Spark releases on the same cluster. However it is not officially supported until HDP version 2.5.
Created 09-28-2016 03:14 PM
@Sami Ahmad, in terms of supported configurations, Spark versions 1.6.2 and 2.0 (in technical preview) can be installed together on HDP 2.5.0. See the following for more info: