Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Not able to load CSD

avatar
Explorer

 

Hello, 

 

I have a cluster that is not able to use its proxy (That's a separate post). In order to install SPARK2, I have attempted to follow the instructions here:  https://www.cloudera.com/documentation/spark2/latest/topics/spark2_installing.html

 

I put the SPARK2 parcel into the /opt/cloudera/csd directory. After restarting the scm-server, I was able to distribute and activate CSD. However, SPARK2 does not appear as an option under "Add  a Service"

 

The only related errors I see is an error in the scm-server log indicating that it failed to load CSD from /opt/cloudera/csd because it has no jar extension. Although I think this is a spurious error because the package has already been distrivuted and activate, I did rename it with a jar extension. Upon restarting, I got an error idicating that there was a ZipException when it tried to uncompress it.  The file does appear to be a valid gzipped tar archive.

 

Any ideas?  Thanks!

1 ACCEPTED SOLUTION

avatar
Expert Contributor

Couple of things to note here:

1. You need to copy the csd to the /opt/cloudera/csd directory.

This is what you want : http://archive.cloudera.com/spark2/csd/SPARK2_ON_YARN-2.1.0.cloudera1.jar

2. The parcel need not be downloaded. It should work after you make this change.

 

Let me know if you have any troubles.

View solution in original post

4 REPLIES 4

avatar
Expert Contributor

Couple of things to note here:

1. You need to copy the csd to the /opt/cloudera/csd directory.

This is what you want : http://archive.cloudera.com/spark2/csd/SPARK2_ON_YARN-2.1.0.cloudera1.jar

2. The parcel need not be downloaded. It should work after you make this change.

 

Let me know if you have any troubles.

avatar
Explorer

Hi,

where i can find the default cdh'csd and others ,like kafka?

avatar
Expert Contributor

The code is available here[1].

The csds are by default preinstalled in CM though.

 

[1]: https://github.com/cloudera/cm_csds

avatar
Explorer

Thanks, i find the repo in cloudera, but what i means, i can not find these csd in the deployed server.