Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

upgrading spark 2.1 to to 2.3.2

Solved Go to solution

upgrading spark 2.1 to to 2.3.2

New Contributor

Hi

I have amabri version 2.6.2 and HDP 2.6.0.3, but this is by default supporting spark 2.1 but my spark job need spark 2.2 or higher.

How to upgrade the spark ?

is it required to upgrade ambari to 2.7 then Hdp to 3.0 or is there a way to upgrade spark directly ?

Regards

Indra

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted

Re: upgrading spark 2.1 to to 2.3.2

@Indra s

HDP 2.6.5 has spark 2.3.0. With the current Ambari version you can just upgrade HDP to 2.6.5.

Please note that as of now you cannot upgrade specific services form ambari it will be a full stack upgrade.

https://docs.hortonworks.com/HDPDocuments/Ambari-2.6.2.2/bk_ambari-upgrade/content/ambari_upgrade_gu...

View solution in original post

2 REPLIES 2
Highlighted

Re: upgrading spark 2.1 to to 2.3.2

@Indra s

HDP 2.6.5 has spark 2.3.0. With the current Ambari version you can just upgrade HDP to 2.6.5.

Please note that as of now you cannot upgrade specific services form ambari it will be a full stack upgrade.

https://docs.hortonworks.com/HDPDocuments/Ambari-2.6.2.2/bk_ambari-upgrade/content/ambari_upgrade_gu...

View solution in original post

Highlighted

Re: upgrading spark 2.1 to to 2.3.2

@Indra s If you found this answer addressed your question, please take a moment to login and click the "accept" link on the answer.

Don't have an account?
Coming from Hortonworks? Activate your account here