How can I have two Spark Services on Ambari from the same Major Version or just update Spark, not entire HDP.

[#1]

I am running on HDP 2.6.4 and I have Spark 2.2.0 there.

Let's say that I want to add Spark 2.3.1 there, is it possible to do via Ambari or just a manual install? So, is it possible to have 2 Spark services managed by Ambari for the same Major Version?

If not, is it possible to upgrade just Spark and not the entire HDP?

Thanks in advance!

[#2 · Accepted solution]

Hi @Thiago de Faria ,

Currently, ambari supports managing only One cluster and one HDP version.

If you would like to upgrade only your spark version I would suggest you to mannually install a seperate spark server referring to this document: https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.5/bk_spark-component-guide/content/install-sp...

As per docs.hortonworks.com the HDP-2.6.5 contains Spark-2.3.0

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.5/bk_release-notes/content/comp_versions.html

Its not suggested to upgrade only Spark with all your HDP components remaining in HDP-2.6.4

Please accept the answer if this helped you.

[#3]

Thanks @Akhil S Naik!

Yeah... I suspected so. It was worth a shot... 🙂