After upgrading Ambari from 2.2.2 to 220.127.116.11 and HDP from 2.4.3 to 18.104.22.168, I tried adding service spark2. I followed this guide , tried to add new service but could not find spark2. I checked the services in Admin -> Stack and Version and No spark2 there but I found Spark2 in Admin -> Manage Ambari -> Versions -> HDP22.214.171.124. And hdp-select also shows spark2 is in hdp repo
By the way, I also tried install spark2 through yum install spark2-master spark2-python( I use python as main develop lang). But pyspark shows:
File "/usr/hdp/current/spark2-client/python/pyspark/shell.py", line 33, in <module>
from pyspark.sql import SparkSession, SQLContext
ImportError: cannot import name SparkSession
If I can not install spark2 in Ambari, I want to use spark2-client at lest.
The screenshots following: