Creating new Service using CSD-Custom Service descriptors

[#1]

Hi,

I am working on creating new servive using CSD. I am able to create basic CSD by following the URL https://github.com/cloudera/cm_ext/wiki/CSD-Overview

For this service, we would like to create UI similar to Spark service Master Web UI which runs on 18080. How to create this UI ?

Is this UI code is part of Spark CSD ?

any help will be appreciated.

Thanks,
Ramana.

[#2]

Hi Ramana,
The Spark Master Web UI is from the Spark project. The CSD doesn't have the
code for it. If you want a similar UI, you are probably better off looking
at how say the Hadoop Namenode UI or the Spark master UI is written.

[#3]

Hi mgrover,

Thanks for the answer.

I thought of that. My question is if we are installing Spark using CSD, then Spark CSD jar contains the code for UI as well ? I don't any UI code in the Spark CSD implementaion provided here https://github.com/cloudera/cm_csds/tree/master/SPARK

So, When the spark is installed through CSD, How the UI code will be deployed ?

Thanks,

Ramana.

[#4]

Hi Ramana,
What UI code are you referring to? Assuming you are referring to the Spark
Master UI (and not the Cloudera Manager UI), that code is a part of Spark
binaries that are delivered as a part of the CDH parcel.

[#5]

Yes. I am referring to Spark Master UI.

My requirement is to create test service using CSD and need to have something similar to Spark Master UI for this new service. In the new service UI, I need to display custom configurations related to the new service.

In this case, Is it possible to do this using CSD only ?

Or I need to have parcels for my new service. How is easy to create parcels for new service ?

Thanks,

Ramana.

[#6 · Accepted solution]

I am stretching the limits of my knowledge of CSD guts but I am pretty sure
CSDs can't do that. They are only for managing services. Any code that you
want to be deployed will have to be in your parcel. It's fairly
straightforward to create a parcel. It's a tarball with some additional
metadata in it.

Here are a few good starting points:
http://blog.cloudera.com/blog/2013/05/faq-understanding-the-parcel-binary-distribution-format/
https://github.com/cloudera/cm_ext
https://github.com/cloudera/cm_ext/wiki/Building-a-parcel
https://github.com/cloudera/cm_ext/wiki/The%20parcel%20format
(Optional)
https://github.com/cloudera/cm_ext/wiki/The-parcel-repository-format

[#7]

Thank You mgrover for all the answers.