question Re: How to use spark older version in Support Questions

How to use spark older version

shyam_kf657 — Tue, 30 Apr 2019 02:18:12 GMT

Hi Team,

We upgraded our spark to 2.3.0.2.6.5.0-292. When I export the spark_major_version=2, and if I type spark-shell then it will be connecting to 2.3.0.2.6.5.0-292. I want to use spark 2.1.0.2.6.0.23-2 version, how can I do that. Please help us on this.

Re: How to use spark older version

shyam_kf657 — Tue, 30 Apr 2019 02:40:46 GMT

Hi Team,

Got the answer, we have to use SPARK_HOME and then run the spark-shell.

export SPARK_HOME=/usr/hdp/2.6.0.23-2/spark2

export SPARK_MAJOR_VERSION=2

spark-shell

then it will connect to 2.6.0.23