Created on 06-25-2019 04:38 AM - edited 08-17-2019 02:51 PM
Hi.
I am using Ambari with HDP-2.6.0.3 where I have a spark installation. When I check the spark version through Ambari Web UI, it shows v2.3. however, when I check it through the console by using ./bin/spark-submit --version, the version observed is 2.1.0.2.6.3-8.
I need to use the v2.3 to run a .jar but it looks like it is using v2.1 instead. How can I set up the 2.3 version?? or do I have something incorrectly configured?
Thanks a lot.
The following images show the outputs: