Support Questions

Find answers, ask questions, and share your expertise
Announcements
Welcome to the upgraded Community! Read this blog to see What’s New!

Not able to load CSD

avatar
Explorer

 

Hello, 

 

I have a cluster that is not able to use its proxy (That's a separate post). In order to install SPARK2, I have attempted to follow the instructions here:  https://www.cloudera.com/documentation/spark2/latest/topics/spark2_installing.html

 

I put the SPARK2 parcel into the /opt/cloudera/csd directory. After restarting the scm-server, I was able to distribute and activate CSD. However, SPARK2 does not appear as an option under "Add  a Service"

 

The only related errors I see is an error in the scm-server log indicating that it failed to load CSD from /opt/cloudera/csd because it has no jar extension. Although I think this is a spurious error because the package has already been distrivuted and activate, I did rename it with a jar extension. Upon restarting, I got an error idicating that there was a ZipException when it tried to uncompress it.  The file does appear to be a valid gzipped tar archive.

 

Any ideas?  Thanks!

1 ACCEPTED SOLUTION

avatar
Rising Star

Couple of things to note here:

1. You need to copy the csd to the /opt/cloudera/csd directory.

This is what you want : http://archive.cloudera.com/spark2/csd/SPARK2_ON_YARN-2.1.0.cloudera1.jar

2. The parcel need not be downloaded. It should work after you make this change.

 

Let me know if you have any troubles.

View solution in original post

4 REPLIES 4

avatar
Rising Star

Couple of things to note here:

1. You need to copy the csd to the /opt/cloudera/csd directory.

This is what you want : http://archive.cloudera.com/spark2/csd/SPARK2_ON_YARN-2.1.0.cloudera1.jar

2. The parcel need not be downloaded. It should work after you make this change.

 

Let me know if you have any troubles.

avatar
Explorer

Hi,

where i can find the default cdh'csd and others ,like kafka?

avatar
Rising Star

The code is available here[1].

The csds are by default preinstalled in CM though.

 

[1]: https://github.com/cloudera/cm_csds

avatar
Explorer

Thanks, i find the repo in cloudera, but what i means, i can not find these csd in the deployed server.

 

Labels