Support Questions
Find answers, ask questions, and share your expertise

Spark 2 Technical preview with patches

Ambari will support the installation of spark 2.0.0 as a technical preview. This version of spark contains a lot of bugs which are fixed in 2.0.2 or 2.1.0 how can I install any of these versions via ambari?

1 ACCEPTED SOLUTION

Accepted Solutions

Re: Spark 2 Technical preview with patches

Expert Contributor

Ambari should be giving the option of which HDP 2.5.x version to install. Choosing higher versions would give higher Apache versions. E.g. HDP 2.5.3 will give Apache Spark 2.0.1. The next HDP 2.5.4+ release will give 2.0.2

HDP 2.6 (not released yet) will have Apache Spark 2.1. You can try a tech preview of that on HDC

View solution in original post

4 REPLIES 4

Re: Spark 2 Technical preview with patches

Explorer

Thats a good question, because the version selection is on the same page, and before you point to the repos...

Re: Spark 2 Technical preview with patches

Expert Contributor

Ambari should be giving the option of which HDP 2.5.x version to install. Choosing higher versions would give higher Apache versions. E.g. HDP 2.5.3 will give Apache Spark 2.0.1. The next HDP 2.5.4+ release will give 2.0.2

HDP 2.6 (not released yet) will have Apache Spark 2.1. You can try a tech preview of that on HDC

View solution in original post

Re: Spark 2 Technical preview with patches

Great. Do you know when 2.5.4 should be released?

Re: Spark 2 Technical preview with patches

Mentor

@Georg Heiler we are not keen on publishing timelines. Shouldn't be too long.