Archives of Support Questions (Read Only)

This is an archived board for historical reference. Information and links may no longer be available or relevant
Announcements
This board is archived and read-only for historical reference. To ask a new question, please post a new topic on the appropriate active board.

spark installation 1.4 on hdp 2.3.4

avatar

How to install spark 1.4 on HDP 2.3.4. Because by default version on HDP 2.3.4 spark version is 1.5.

1 ACCEPTED SOLUTION

avatar
Super Guru

I think you can't do it through Ambari, either you can install it manually and build it from spark 1.4 source code. We recommend to keep one spark version which comes with HDP stack.

https://spark.apache.org/docs/1.4.1/building-spark.html

View solution in original post

10 REPLIES 10

avatar

I resolved the issue, with downgrade the version.

steps what I perform

stpe 1:-

cat /etc/yum.repos.d/HDP-TP.repo

#VERSION_NUMBER=2.3.2.0-2950

[HDP-2.3.2.0]

name=HDP Version - HDP-2.3.2.0

baseurl=http://public-repo-1.hortonworks.com/HDP/centos7/2.x/updates/2.3.2.0

gpgcheck=1

gpgkey=http://public-repo-1.hortonworks.com/HDP/centos7/2.x/updates/2.3.2.0/RPM-GPG-KEY/RPM-GPG-KEY-Jenkins

enabled=1

priority=1

[HDP-UTILS-1.1.0.20]

name=HDP Utils Version - HDP-UTILS-1.1.0.20

baseurl=http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.20/repos/centos7

gpgcheck=1

gpgkey=http://public-repo-1.hortonworks.com/HDP/centos7/2.x/updates/2.3.2.0/RPM-GPG-KEY/RPM-GPG-KEY-Jenkins

enabled=1

priority=1

step2:-

yum install spark_2_3_2_0_2950*

To check go to /usr/hdp/2.3.2.0-2950/spark/sbin

Step 3:- start ./start-all.sh