Hi. I am using Ambari with HDP-2.6.0.3 where I have a spark installation. When I check the spark version through Ambari Web UI, it shows v2.3. however, when I check it through the console by using ./bin/spark-submit --version, the version observed is 2.1.0.2.6.3-8. I need to use the v2.3 to run a .jar but it looks like it is using v2.1 instead. How can I set up the 2.3 version?? or do I have something incorrectly configured? Thanks a lot. The following images show the outputs:
... View more
