Support Questions
Find answers, ask questions, and share your expertise

Spark version in console different to version displayed in Ambari

Spark version in console different to version displayed in Ambari

New Contributor

Hi.

I am using Ambari with HDP-2.6.0.3 where I have a spark installation. When I check the spark version through Ambari Web UI, it shows v2.3. however, when I check it through the console by using ./bin/spark-submit --version, the version observed is 2.1.0.2.6.3-8.

I need to use the v2.3 to run a .jar but it looks like it is using v2.1 instead. How can I set up the 2.3 version?? or do I have something incorrectly configured?

Thanks a lot.


The following images show the outputs:

109537-console-version.png

109542-ambari-version.png

Don't have an account?