Support Questions
Find answers, ask questions, and share your expertise

install custom spark on CDH

Highlighted

install custom spark on CDH

New Contributor

Hi,

 

We have a CDH 5.4.8 (express), using Parcels.

We are happy with that, but we want to use very recent versions of Spark.

 

For now, we manually installed the latest spark on an "edge node" and we initiate jobs from there. 

 

But I would like to manage this from CM.

Is there a way to build a custom Parcel (or custom whatever) to have CM deploy the spark version we want ?

 

Thanks for your hints and advices.

 

Mathieu