07-26-2017 11:36 PM
This (not seeing Spark2 in 'Add a Service' wizard) is generally a result of Cloudera Management Services not being restarted (or CM not recognizing the CSD)
07-28-2017 12:21 PM
10-19-2017 05:32 AM
Yes I restart both CM server and cloudera management service both and still it is not showing Spark2 as service in cluster.
I see JDK 1.7 used with CDH 5.9 on cluster I'm on. I read somewhere that Spark 2 requires JDK 1.8. Could that be stopping to get spark2 service.
10-19-2017 07:25 AM
Also, is there way to confirm csd file is properly deployed. Also, I don't see scala 11 libraries under /opt/cloudera/parcels/CDH/jars and only scala 10 libraries.
I heard that scala 10 and 11 both are installed with CDH 5.7 and later. Shouldn't scala 11 be available, Is this also cause for spark2 service not appearing.
I did all steps as mentioned and all steps did completely successfully, spark2 parcel is activated now.