Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]

Cloudera Community

Support Questions

Find answers, ask questions, and share your expertise
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Show  only  | Search instead for 
Did you mean: 
Advanced Search
Announcements
Share your experience with Cloudera on G2 and get a $25 Amazon Gift card.
Hi, I'm CLEO! Something exciting is coming to the Community. Stay Tuned!
Solved Go to solution

How to use spark older version

Labels:
avatar
author-rank shyam_kf657
New Member

Created ‎04-29-2019 07:18 PM

Hi Team,


We upgraded our spark to 2.3.0.2.6.5.0-292. When I export the spark_major_version=2, and if I type spark-shell then it will be connecting to 2.3.0.2.6.5.0-292. I want to use spark 2.1.0.2.6.0.23-2 version, how can I do that. Please help us on this.

3,897 Views
0 Kudos
1 ACCEPTED SOLUTION

avatar
author-rank shyam_kf657
New Member

Created ‎04-29-2019 07:40 PM

Hi Team,


Got the answer, we have to use SPARK_HOME and then run the spark-shell.

export SPARK_HOME=/usr/hdp/2.6.0.23-2/spark2

export SPARK_MAJOR_VERSION=2

spark-shell

then it will connect to 2.6.0.23


View solution in original post

3,830 Views
0 Kudos
1 REPLY 1

avatar
author-rank shyam_kf657
New Member

Created ‎04-29-2019 07:40 PM

Hi Team,


Got the answer, we have to use SPARK_HOME and then run the spark-shell.

export SPARK_HOME=/usr/hdp/2.6.0.23-2/spark2

export SPARK_MAJOR_VERSION=2

spark-shell

then it will connect to 2.6.0.23


3,831 Views
0 Kudos
Announcements
Community Announcements
Community Upgrade Announcement
What's New @ Cloudera
Announcing Cloudera Flow Management Operator for Kubernetes ...
What's New @ Cloudera
Announcing Cloudera Streams Messaging Operator for Kubernete...
Community Announcements
July 2026 Community Highlights
Community Announcements
June 2026 Community Highlights
View More Announcements