I deployed the spark2 csd and activated the parcels without any obvious issues but the spark2_on_yarn service is still not available as an option to add to an existing cluster .
I checked the permission in /opt/cloudera/csd and they seem correct :
[root@ha-r1-u33 ~]# ls -ltr /opt/cloudera/csd/
-rw-r--r-- 1 cloudera-scm cloudera-scm 15765 Feb 3 05:53 SPARK2_ON_YARN-2.0.0.cloudera1.jar
-rw-r--r-- 1 cloudera-scm cloudera-scm 19899 Feb 3 06:19 KUDU-1.0.0.jar
and also restarted the management services after adding the csd .
any idea on where I should look ?