Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Spark version in console different to version displayed in Ambari

Highlighted

Spark version in console different to version displayed in Ambari

New Contributor

Hi.

I am using Ambari with HDP-2.6.0.3 where I have a spark installation. When I check the spark version through Ambari Web UI, it shows v2.3. however, when I check it through the console by using ./bin/spark-submit --version, the version observed is 2.1.0.2.6.3-8.

I need to use the v2.3 to run a .jar but it looks like it is using v2.1 instead. How can I set up the 2.3 version?? or do I have something incorrectly configured?

Thanks a lot.


The following images show the outputs:

109537-console-version.png

109542-ambari-version.png