I am running CDH and CM 6.1.x and trying to install Spark 2.3- however after distributing the parcel, when I choose "activate" I get the following message:
Actually, I see that the jar I am trying to use appears to be for cdh 5.13. Is there one for 6.x?
I was able to get the parcel activated, but now Spark2 does not display under "Add Services", even after restarting via the instructions.
Spark 2.4 service is now (in C6.1) provided by the CDH parcel. There is no separate Spark2 parcel now. Please refer to the following link about Migrating Apache Spark Before Upgrading to CDH 6 :
CDH 6.1 package comes with spark 2.4 version. please see the below link for more information