Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Not able to load CSD

Solved Go to solution
Highlighted

Not able to load CSD

Explorer

 

Hello, 

 

I have a cluster that is not able to use its proxy (That's a separate post). In order to install SPARK2, I have attempted to follow the instructions here:  https://www.cloudera.com/documentation/spark2/latest/topics/spark2_installing.html

 

I put the SPARK2 parcel into the /opt/cloudera/csd directory. After restarting the scm-server, I was able to distribute and activate CSD. However, SPARK2 does not appear as an option under "Add  a Service"

 

The only related errors I see is an error in the scm-server log indicating that it failed to load CSD from /opt/cloudera/csd because it has no jar extension. Although I think this is a spurious error because the package has already been distrivuted and activate, I did rename it with a jar extension. Upon restarting, I got an error idicating that there was a ZipException when it tried to uncompress it.  The file does appear to be a valid gzipped tar archive.

 

Any ideas?  Thanks!

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted

Re: Not able to load CSD

Rising Star

Couple of things to note here:

1. You need to copy the csd to the /opt/cloudera/csd directory.

This is what you want : http://archive.cloudera.com/spark2/csd/SPARK2_ON_YARN-2.1.0.cloudera1.jar

2. The parcel need not be downloaded. It should work after you make this change.

 

Let me know if you have any troubles.

View solution in original post

4 REPLIES 4
Highlighted

Re: Not able to load CSD

Rising Star

Couple of things to note here:

1. You need to copy the csd to the /opt/cloudera/csd directory.

This is what you want : http://archive.cloudera.com/spark2/csd/SPARK2_ON_YARN-2.1.0.cloudera1.jar

2. The parcel need not be downloaded. It should work after you make this change.

 

Let me know if you have any troubles.

View solution in original post

Highlighted

Re: Not able to load CSD

Explorer

Hi,

where i can find the default cdh'csd and others ,like kafka?

Highlighted

Re: Not able to load CSD

Rising Star

The code is available here[1].

The csds are by default preinstalled in CM though.

 

[1]: https://github.com/cloudera/cm_csds

Highlighted

Re: Not able to load CSD

Explorer

Thanks, i find the repo in cloudera, but what i means, i can not find these csd in the deployed server.

 

Don't have an account?
Coming from Hortonworks? Activate your account here