Reply
New Contributor
Posts: 4
Registered: ‎09-18-2014
Accepted Solution

Creating new Service using CSD-Custom Service descriptors

Hi,

I am working on creating new servive using CSD. I am able to create basic CSD by following the URL https://github.com/cloudera/cm_ext/wiki/CSD-Overview

 

For this service, we would like to create UI similar to Spark service Master Web UI which runs on 18080. How to create this UI ?

 

Is this UI code is part of Spark CSD ?

 

any help will be appreciated.

 

Thanks,
Ramana.

 

Cloudera Employee
Posts: 62
Registered: ‎07-29-2013

Re: Creating new Service using CSD-Custom Service descriptors

Hi Ramana,
The Spark Master Web UI is from the Spark project. The CSD doesn't have the
code for it. If you want a similar UI, you are probably better off looking
at how say the Hadoop Namenode UI or the Spark master UI is written.

New Contributor
Posts: 4
Registered: ‎09-18-2014

Re: Creating new Service using CSD-Custom Service descriptors

Hi mgrover,

 

Thanks for the answer.

 

I thought of that. My question is if we are installing Spark using CSD, then Spark CSD jar contains the code for UI as well ? I don't any UI code in the Spark CSD implementaion provided here https://github.com/cloudera/cm_csds/tree/master/SPARK

 

So, When the spark is installed through CSD, How the UI code will be deployed ?

 

Thanks,

Ramana.

 

Cloudera Employee
Posts: 62
Registered: ‎07-29-2013

Re: Creating new Service using CSD-Custom Service descriptors

Hi Ramana,
What UI code are you referring to? Assuming you are referring to the Spark
Master UI (and not the Cloudera Manager UI), that code is a part of Spark
binaries that are delivered as a part of the CDH parcel.

New Contributor
Posts: 4
Registered: ‎09-18-2014

Re: Creating new Service using CSD-Custom Service descriptors

Yes. I am referring to Spark Master UI.

 

My requirement is to create test service using CSD and need to have something similar to Spark Master UI for this new service. In the new service UI, I need to display custom configurations related to the new service.

 

In this case, Is it possible to do this using CSD only ?

 

Or I need to have parcels for my new service. How is easy to create parcels for new service ?

 

Thanks,

Ramana.

 

 

 

Highlighted
Cloudera Employee
Posts: 62
Registered: ‎07-29-2013

Re: Creating new Service using CSD-Custom Service descriptors

I am stretching the limits of my knowledge of CSD guts but I am pretty sure
CSDs can't do that. They are only for managing services. Any code that you
want to be deployed will have to be in your parcel. It's fairly
straightforward to create a parcel. It's a tarball with some additional
metadata in it.

Here are a few good starting points:
http://blog.cloudera.com/blog/2013/05/faq-understanding-the-parcel-binary-distribution-format/
https://github.com/cloudera/cm_ext
https://github.com/cloudera/cm_ext/wiki/Building-a-parcel
https://github.com/cloudera/cm_ext/wiki/The%20parcel%20format
(Optional)
https://github.com/cloudera/cm_ext/wiki/The-parcel-repository-format

New Contributor
Posts: 4
Registered: ‎09-18-2014

Re: Creating new Service using CSD-Custom Service descriptors

Thank You mgrover for all the answers.

Announcements