question How to upgrade HDP spark version in Archives of Support Questions (Read Only)

How to upgrade HDP spark version

cokorda_putra — Tue, 16 Feb 2016 11:57:09 GMT

Hi,

How is the best practice for upgrading spark 1.4 to spark 1.5 on HDP-2.3.2.0-2950 in using ubuntu OS

Re: How to upgrade HDP spark version

pminovic — Tue, 16 Feb 2016 13:07:31 GMT

Hi @cokorda putra susila, please find here instructions how to try Spark-1.5 on HDP-2.3.2.

Re: How to upgrade HDP spark version

cokorda_putra — Tue, 16 Feb 2016 14:36:10 GMT

hi @Predrag Minovic

thanks for the answer,

do you mean i just need to follow the tutorial?

i didn't see the example for ubuntu? it's the same way with centos?

Re: How to upgrade HDP spark version

pminovic — Tue, 16 Feb 2016 14:43:22 GMT

There is an URL for Ubuntu, then just use "apt-get install" instead of yum. The rest should be the same. Another option, if doable for you, is to upgrade the whole cluster to HDP-2.3.4, it contains Spark-1.5 and you can try Spark-1.6 as a tech preview.

Re: How to upgrade HDP spark version

aervits — Tue, 16 Feb 2016 19:11:08 GMT

@cokorda putra susilaspark 1.5.2 is officially supported in hdp2.3.4 please upgrade to HDP 2.3.4 for that version of spark. We will support individual components like spark upgrade in the future.

Re: How to upgrade HDP spark version

cokorda_putra — Wed, 17 Feb 2016 20:40:33 GMT

hi @Artem Ervits

yes i upgrade the HDP to 2.3.4

but i got a litle problem while i try to upgrade spark 1.5 to 1.6

here is my question about that

question

Re: How to upgrade HDP spark version

aervits — Wed, 17 Feb 2016 20:43:07 GMT

Spark 1.6 is not supported yet. I answered in the other thread to install Spark client @cokorda putra susila