Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

What to do with Spark 2.0 CSD jar

Solved Go to solution

What to do with Spark 2.0 CSD jar

Contributor

The CSD download link given actually points to a jar file with the following directory tree:

 

$ jar tvf SPARK2_ON_YARN-2.0.0.cloudera.beta1.jar
0 Wed Sep 21 17:24:28 CDT 2016 descriptor/
0 Wed Sep 21 17:24:28 CDT 2016 scripts/
0 Wed Sep 21 17:24:28 CDT 2016 aux/
0 Wed Sep 21 17:24:28 CDT 2016 aux/client/
3312 Wed Sep 21 17:24:28 CDT 2016 images/icon.png
1711 Wed Sep 21 17:24:28 CDT 2016 aux/client/spark-env.sh
0 Wed Sep 21 17:24:28 CDT 2016 images/
18456 Wed Sep 21 17:24:28 CDT 2016 descriptor/service.sdl
0 Wed Sep 21 17:50:46 CDT 2016 meta/
20 Wed Sep 21 17:50:46 CDT 2016 meta/version
0 Wed Sep 21 17:50:58 CDT 2016 META-INF/
1813 Wed Sep 21 17:24:28 CDT 2016 scripts/control.sh
12362 Wed Sep 21 17:24:28 CDT 2016 scripts/common.sh
104 Wed Sep 21 17:50:58 CDT 2016 META-INF/MANIFEST.MF

 

 

Now, when the documentation specifies "install Spark2 CSD", which file(s) is it referring to exactly?  Just descriptor/service.sdl, or the entire jar to /opt/cloudera/csd?  The two scripts above look like operational scripts for CM.

 

Thanks,

Miles Yao

 

 

1 ACCEPTED SOLUTION

Accepted Solutions

Re: What to do with Spark 2.0 CSD jar

Rising Star

Hello,

 

You have to move the SPARK2_ON_YARN-2.0.0.cloudera.beta1.jar to here:

 

/opt/cloudera/csd

 

and restart the Cloudera Manager with the following command:

 

service cloudera-scm-server restart

 

 

Here are the other steps:

 

https://www.cloudera.com/documentation/betas/spark2/latest/topics/spark2_installing.html

 

Best regards,

 

      Gabor

2 REPLIES 2

Re: What to do with Spark 2.0 CSD jar

Rising Star

Hello,

 

You have to move the SPARK2_ON_YARN-2.0.0.cloudera.beta1.jar to here:

 

/opt/cloudera/csd

 

and restart the Cloudera Manager with the following command:

 

service cloudera-scm-server restart

 

 

Here are the other steps:

 

https://www.cloudera.com/documentation/betas/spark2/latest/topics/spark2_installing.html

 

Best regards,

 

      Gabor

Highlighted

Re: What to do with Spark 2.0 CSD jar

Contributor

Yes, that works. 

"CSD file" sounds like a text config file.  Adding a simple description that it's a JAR in the instruction page would have clarified.

 

Thanks again.

Miles