Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

How to upgrade HDP spark version

avatar
Contributor

Hi,

How is the best practice for upgrading spark 1.4 to spark 1.5 on HDP-2.3.2.0-2950 in using ubuntu OS

1 ACCEPTED SOLUTION

avatar
Master Mentor

@cokorda putra susilaspark 1.5.2 is officially supported in hdp2.3.4 please upgrade to HDP 2.3.4 for that version of spark. We will support individual components like spark upgrade in the future.

View solution in original post

6 REPLIES 6

avatar
Master Guru

Hi @cokorda putra susila, please find here instructions how to try Spark-1.5 on HDP-2.3.2.

avatar
Contributor

hi @Predrag Minovic

thanks for the answer,

do you mean i just need to follow the tutorial?

i didn't see the example for ubuntu? it's the same way with centos?

avatar
Master Guru

There is an URL for Ubuntu, then just use "apt-get install" instead of yum. The rest should be the same. Another option, if doable for you, is to upgrade the whole cluster to HDP-2.3.4, it contains Spark-1.5 and you can try Spark-1.6 as a tech preview.

avatar
Master Mentor

@cokorda putra susilaspark 1.5.2 is officially supported in hdp2.3.4 please upgrade to HDP 2.3.4 for that version of spark. We will support individual components like spark upgrade in the future.

avatar
Contributor

hi @Artem Ervits

yes i upgrade the HDP to 2.3.4

but i got a litle problem while i try to upgrade spark 1.5 to 1.6

here is my question about that

question

avatar
Master Mentor

Spark 1.6 is not supported yet. I answered in the other thread to install Spark client @cokorda putra susila