How do I activate a parcel in a Cloudera Director script ? [ Edited ]

[dmnpignaud]

Hi there,

I would like to install Spark 2 on a cluster that is set up through a Cloudera Director script.
I used this script as an example : https://github.com/cloudera/director-scripts/blob/master/configs/aws.reference.conf
More precisely, I did :

cloudera-manager {
	csds: [
		"http://archive.cloudera.com/spark2/csd/SPARK2_ON_YARN-2.2.0.cloudera1.jar"
  	]
}

cluster {
	products {
  		...
		SPARK2: 2
	}
	parcelRepositories: ["http://archive.cloudera.com/spark2/parcels/2.2.0.cloudera1/"]
	services : [..., SPARK2-ON_YARN]
	masters-1 {
		roles {
			SPARK2_ON_YARN: [SPARK2_YARN_HISTORY_SERVER]
	  }
	}
}

However, the Spark2 service never starts and when I attempt do start it manually through the Cloudera Manager interface, I get the following error :
"This role requires the following additional parcels to be activated before it can start: [spark2]."

Do you have any idea of what is missing in the configuration ?

Thank you in advance.

[aarman]

That conf looks right to me. Though the service should be SPARK2_ON_YARN instead of SPARK2-ON_YARN. Also can you verify that you hava Java 8 installed which is a requirement for Spark 2, see here for additional details.