Reply
New Contributor
Posts: 4
Registered: ‎02-09-2017

How do I activate a parcel in a Cloudera Director script ?

[ Edited ]

Hi there,


I would like to install Spark 2 on a cluster that is set up through a Cloudera Director script.
I used this script as an example : https://github.com/cloudera/director-scripts/blob/master/configs/aws.reference.conf
More precisely, I did :

 

cloudera-manager {
	csds: [
		"http://archive.cloudera.com/spark2/csd/SPARK2_ON_YARN-2.2.0.cloudera1.jar"
  	]
}

cluster {
	products {
  		...
		SPARK2: 2
	}
	parcelRepositories: ["http://archive.cloudera.com/spark2/parcels/2.2.0.cloudera1/"]
	services : [..., SPARK2-ON_YARN]
	masters-1 {
		roles {
			SPARK2_ON_YARN: [SPARK2_YARN_HISTORY_SERVER]
	  }
	}
}


However, the Spark2 service never starts and when I attempt do start it manually through the Cloudera Manager interface, I get the following error :
"This role requires the following additional parcels to be activated before it can start: [spark2]."

 

Do you have any idea of what is missing in the configuration ?


Thank you in advance.

Cloudera Employee
Posts: 24
Registered: ‎08-24-2015

Re: How do I activate a parcel in a Cloudera Director script ?

That conf looks right to me. Though the service should be SPARK2_ON_YARN instead of SPARK2-ON_YARN. Also can you verify that you hava Java 8 installed which is a requirement for Spark 2, see here for additional details.

Announcements