Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

How can I have two Spark Services on Ambari from the same Major Version or just update Spark, not entire HDP.

Solved Go to solution
Highlighted

How can I have two Spark Services on Ambari from the same Major Version or just update Spark, not entire HDP.

New Contributor

I am running on HDP 2.6.4 and I have Spark 2.2.0 there.

Let's say that I want to add Spark 2.3.1 there, is it possible to do via Ambari or just a manual install? So, is it possible to have 2 Spark services managed by Ambari for the same Major Version?


If not, is it possible to upgrade just Spark and not the entire HDP?

Thanks in advance!

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted

Re: How can I have two Spark Services on Ambari from the same Major Version or just update Spark, not entire HDP.

Hi @Thiago de Faria ,

Currently, ambari supports managing only One cluster and one HDP version.

If you would like to upgrade only your spark version I would suggest you to mannually install a seperate spark server referring to this document: https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.5/bk_spark-component-guide/content/install-sp...

As per docs.hortonworks.com the HDP-2.6.5 contains Spark-2.3.0

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.5/bk_release-notes/content/comp_versions.html

Its not suggested to upgrade only Spark with all your HDP components remaining in HDP-2.6.4

Please accept the answer if this helped you.

View solution in original post

2 REPLIES 2
Highlighted

Re: How can I have two Spark Services on Ambari from the same Major Version or just update Spark, not entire HDP.

Hi @Thiago de Faria ,

Currently, ambari supports managing only One cluster and one HDP version.

If you would like to upgrade only your spark version I would suggest you to mannually install a seperate spark server referring to this document: https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.5/bk_spark-component-guide/content/install-sp...

As per docs.hortonworks.com the HDP-2.6.5 contains Spark-2.3.0

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.5/bk_release-notes/content/comp_versions.html

Its not suggested to upgrade only Spark with all your HDP components remaining in HDP-2.6.4

Please accept the answer if this helped you.

View solution in original post

Highlighted

Re: How can I have two Spark Services on Ambari from the same Major Version or just update Spark, not entire HDP.

New Contributor

Thanks @Akhil S Naik!

Yeah... I suspected so. It was worth a shot... :-)

Don't have an account?
Coming from Hortonworks? Activate your account here