Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

What to do with Spark 2.0 CSD jar

avatar
Expert Contributor

The CSD download link given actually points to a jar file with the following directory tree:

 

$ jar tvf SPARK2_ON_YARN-2.0.0.cloudera.beta1.jar
0 Wed Sep 21 17:24:28 CDT 2016 descriptor/
0 Wed Sep 21 17:24:28 CDT 2016 scripts/
0 Wed Sep 21 17:24:28 CDT 2016 aux/
0 Wed Sep 21 17:24:28 CDT 2016 aux/client/
3312 Wed Sep 21 17:24:28 CDT 2016 images/icon.png
1711 Wed Sep 21 17:24:28 CDT 2016 aux/client/spark-env.sh
0 Wed Sep 21 17:24:28 CDT 2016 images/
18456 Wed Sep 21 17:24:28 CDT 2016 descriptor/service.sdl
0 Wed Sep 21 17:50:46 CDT 2016 meta/
20 Wed Sep 21 17:50:46 CDT 2016 meta/version
0 Wed Sep 21 17:50:58 CDT 2016 META-INF/
1813 Wed Sep 21 17:24:28 CDT 2016 scripts/control.sh
12362 Wed Sep 21 17:24:28 CDT 2016 scripts/common.sh
104 Wed Sep 21 17:50:58 CDT 2016 META-INF/MANIFEST.MF

 

 

Now, when the documentation specifies "install Spark2 CSD", which file(s) is it referring to exactly?  Just descriptor/service.sdl, or the entire jar to /opt/cloudera/csd?  The two scripts above look like operational scripts for CM.

 

Thanks,

Miles Yao

 

 

1 ACCEPTED SOLUTION

avatar
Expert Contributor

Hello,

 

You have to move the SPARK2_ON_YARN-2.0.0.cloudera.beta1.jar to here:

 

/opt/cloudera/csd

 

and restart the Cloudera Manager with the following command:

 

service cloudera-scm-server restart

 

 

Here are the other steps:

 

https://www.cloudera.com/documentation/betas/spark2/latest/topics/spark2_installing.html

 

Best regards,

 

      Gabor

View solution in original post

2 REPLIES 2

avatar
Expert Contributor

Hello,

 

You have to move the SPARK2_ON_YARN-2.0.0.cloudera.beta1.jar to here:

 

/opt/cloudera/csd

 

and restart the Cloudera Manager with the following command:

 

service cloudera-scm-server restart

 

 

Here are the other steps:

 

https://www.cloudera.com/documentation/betas/spark2/latest/topics/spark2_installing.html

 

Best regards,

 

      Gabor

avatar
Expert Contributor

Yes, that works. 

"CSD file" sounds like a text config file.  Adding a simple description that it's a JAR in the instruction page would have clarified.

 

Thanks again.

Miles