question Re: Spark 2 Technical preview with patches in Support Questions

Spark 2 Technical preview with patches

georg_kf_heiler — Wed, 15 Feb 2017 14:24:26 GMT

Ambari will support the installation of spark 2.0.0 as a technical preview. This version of spark contains a lot of bugs which are fixed in 2.0.2 or 2.1.0 how can I install any of these versions via ambari?

Re: Spark 2 Technical preview with patches

rbailey — Wed, 15 Feb 2017 14:28:07 GMT

Thats a good question, because the version selection is on the same page, and before you point to the repos...

Re: Spark 2 Technical preview with patches

bikas — Thu, 16 Feb 2017 16:00:39 GMT

Ambari should be giving the option of which HDP 2.5.x version to install. Choosing higher versions would give higher Apache versions. E.g. HDP 2.5.3 will give Apache Spark 2.0.1. The next HDP 2.5.4+ release will give 2.0.2

HDP 2.6 (not released yet) will have Apache Spark 2.1. You can try a tech preview of that on HDC

Re: Spark 2 Technical preview with patches

georg_kf_heiler — Thu, 16 Feb 2017 16:04:25 GMT

Great. Do you know when 2.5.4 should be released?

Re: Spark 2 Technical preview with patches

aervits — Thu, 16 Feb 2017 22:16:21 GMT

@Georg Heiler we are not keen on publishing timelines. Shouldn't be too long.