Support Questions
Find answers, ask questions, and share your expertise
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Spark version in console different to version displayed in Ambari

Highlighted

Spark version in console different to version displayed in Ambari

n10080236
New Contributor

Created on ‎06-25-2019 04:38 AM - edited ‎08-17-2019 02:51 PM

Hi.

I am using Ambari with HDP-2.6.0.3 where I have a spark installation. When I check the spark version through Ambari Web UI, it shows v2.3. however, when I check it through the console by using ./bin/spark-submit --version, the version observed is 2.1.0.2.6.3-8.

I need to use the v2.3 to run a .jar but it looks like it is using v2.1 instead. How can I set up the 2.3 version?? or do I have something incorrectly configured?

Thanks a lot.


The following images show the outputs:

109537-console-version.png

109542-ambari-version.png

Reply
58 Views
0 Kudos
Don't have an account?
Register
Coming from Hortonworks? Activate your account here