question Re: What to do with Spark 2.0 CSD jar in Archives of Support Questions (Read Only)

What to do with Spark 2.0 CSD jar

MilesYao — Fri, 16 Sep 2022 10:46:41 GMT

The CSD download link given actually points to a jar file with the following directory tree:

$ jar tvf SPARK2_ON_YARN-2.0.0.cloudera.beta1.jar
0 Wed Sep 21 17:24:28 CDT 2016 descriptor/
0 Wed Sep 21 17:24:28 CDT 2016 scripts/
0 Wed Sep 21 17:24:28 CDT 2016 aux/
0 Wed Sep 21 17:24:28 CDT 2016 aux/client/
3312 Wed Sep 21 17:24:28 CDT 2016 images/icon.png
1711 Wed Sep 21 17:24:28 CDT 2016 aux/client/spark-env.sh
0 Wed Sep 21 17:24:28 CDT 2016 images/
18456 Wed Sep 21 17:24:28 CDT 2016 descriptor/service.sdl
0 Wed Sep 21 17:50:46 CDT 2016 meta/
20 Wed Sep 21 17:50:46 CDT 2016 meta/version
0 Wed Sep 21 17:50:58 CDT 2016 META-INF/
1813 Wed Sep 21 17:24:28 CDT 2016 scripts/control.sh
12362 Wed Sep 21 17:24:28 CDT 2016 scripts/common.sh
104 Wed Sep 21 17:50:58 CDT 2016 META-INF/MANIFEST.MF

Now, when the documentation specifies "install Spark2 CSD", which file(s) is it referring to exactly? Just descriptor/service.sdl, or the entire jar to /opt/cloudera/csd? The two scripts above look like operational scripts for CM.

Thanks,

Miles Yao

Re: What to do with Spark 2.0 CSD jar

roczei — Sat, 05 Nov 2016 22:12:21 GMT

Hello,

You have to move the SPARK2_ON_YARN-2.0.0.cloudera.beta1.jar to here:

/opt/cloudera/csd

and restart the Cloudera Manager with the following command:

service cloudera-scm-server restart

Here are the other steps:

https://www.cloudera.com/documentation/betas/spark2/latest/topics/spark2_installing.html

Best regards,

Gabor

Re: What to do with Spark 2.0 CSD jar

MilesYao — Tue, 08 Nov 2016 18:03:47 GMT

Yes, that works.

"CSD file" sounds like a text config file. Adding a simple description that it's a JAR in the instruction page would have clarified.

Thanks again.

Miles