- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
How to upgrade HDP spark version
- Labels:
-
Apache Spark
Created ‎02-16-2016 03:57 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi,
How is the best practice for upgrading spark 1.4 to spark 1.5 on HDP-2.3.2.0-2950 in using ubuntu OS
Created ‎02-16-2016 11:11 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
@cokorda putra susilaspark 1.5.2 is officially supported in hdp2.3.4 please upgrade to HDP 2.3.4 for that version of spark. We will support individual components like spark upgrade in the future.
Created ‎02-16-2016 05:07 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi @cokorda putra susila, please find here instructions how to try Spark-1.5 on HDP-2.3.2.
Created ‎02-16-2016 06:36 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
thanks for the answer,
do you mean i just need to follow the tutorial?
i didn't see the example for ubuntu? it's the same way with centos?
Created ‎02-16-2016 06:43 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
There is an URL for Ubuntu, then just use "apt-get install" instead of yum. The rest should be the same. Another option, if doable for you, is to upgrade the whole cluster to HDP-2.3.4, it contains Spark-1.5 and you can try Spark-1.6 as a tech preview.
Created ‎02-16-2016 11:11 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
@cokorda putra susilaspark 1.5.2 is officially supported in hdp2.3.4 please upgrade to HDP 2.3.4 for that version of spark. We will support individual components like spark upgrade in the future.
Created ‎02-17-2016 12:40 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
yes i upgrade the HDP to 2.3.4
but i got a litle problem while i try to upgrade spark 1.5 to 1.6
here is my question about that
Created ‎02-17-2016 12:43 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Spark 1.6 is not supported yet. I answered in the other thread to install Spark client @cokorda putra susila
