Support Questions

Find answers, ask questions, and share your expertise

spark installation 1.4 on hdp 2.3.4

avatar

How to install spark 1.4 on HDP 2.3.4. Because by default version on HDP 2.3.4 spark version is 1.5.

1 ACCEPTED SOLUTION

avatar
Super Guru

I think you can't do it through Ambari, either you can install it manually and build it from spark 1.4 source code. We recommend to keep one spark version which comes with HDP stack.

https://spark.apache.org/docs/1.4.1/building-spark.html

View solution in original post

10 REPLIES 10

avatar

I resolved the issue, with downgrade the version.

steps what I perform

stpe 1:-

cat /etc/yum.repos.d/HDP-TP.repo

#VERSION_NUMBER=2.3.2.0-2950

[HDP-2.3.2.0]

name=HDP Version - HDP-2.3.2.0

baseurl=http://public-repo-1.hortonworks.com/HDP/centos7/2.x/updates/2.3.2.0

gpgcheck=1

gpgkey=http://public-repo-1.hortonworks.com/HDP/centos7/2.x/updates/2.3.2.0/RPM-GPG-KEY/RPM-GPG-KEY-Jenkins

enabled=1

priority=1

[HDP-UTILS-1.1.0.20]

name=HDP Utils Version - HDP-UTILS-1.1.0.20

baseurl=http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.20/repos/centos7

gpgcheck=1

gpgkey=http://public-repo-1.hortonworks.com/HDP/centos7/2.x/updates/2.3.2.0/RPM-GPG-KEY/RPM-GPG-KEY-Jenkins

enabled=1

priority=1

step2:-

yum install spark_2_3_2_0_2950*

To check go to /usr/hdp/2.3.2.0-2950/spark/sbin

Step 3:- start ./start-all.sh