question Creating new Service using CSD-Custom Service descriptors in Support Questions

Creating new Service using CSD-Custom Service descriptors

ramanaopensource — Fri, 16 Sep 2022 09:07:53 GMT

Hi,

I am working on creating new servive using CSD. I am able to create basic CSD by following the URL https://github.com/cloudera/cm_ext/wiki/CSD-Overview

For this service, we would like to create UI similar to Spark service Master Web UI which runs on 18080. How to create this UI ?

Is this UI code is part of Spark CSD ?

any help will be appreciated.

Thanks,
Ramana.

Re: Creating new Service using CSD-Custom Service descriptors

mgrover — Fri, 19 Sep 2014 15:42:39 GMT

Hi Ramana,
The Spark Master Web UI is from the Spark project. The CSD doesn't have the
code for it. If you want a similar UI, you are probably better off looking
at how say the Hadoop Namenode UI or the Spark master UI is written.

Re: Creating new Service using CSD-Custom Service descriptors

ramanaopensource — Fri, 19 Sep 2014 16:56:25 GMT

Hi mgrover,

Thanks for the answer.

I thought of that. My question is if we are installing Spark using CSD, then Spark CSD jar contains the code for UI as well ? I don't any UI code in the Spark CSD implementaion provided here https://github.com/cloudera/cm_csds/tree/master/SPARK

So, When the spark is installed through CSD, How the UI code will be deployed ?

Thanks,

Ramana.

Re: Creating new Service using CSD-Custom Service descriptors

mgrover — Fri, 19 Sep 2014 16:58:38 GMT

Hi Ramana,
What UI code are you referring to? Assuming you are referring to the Spark
Master UI (and not the Cloudera Manager UI), that code is a part of Spark
binaries that are delivered as a part of the CDH parcel.

Re: Creating new Service using CSD-Custom Service descriptors

ramanaopensource — Fri, 19 Sep 2014 17:04:33 GMT

Yes. I am referring to Spark Master UI.

My requirement is to create test service using CSD and need to have something similar to Spark Master UI for this new service. In the new service UI, I need to display custom configurations related to the new service.

In this case, Is it possible to do this using CSD only ?

Or I need to have parcels for my new service. How is easy to create parcels for new service ?

Thanks,

Ramana.

Re: Creating new Service using CSD-Custom Service descriptors

mgrover — Fri, 19 Sep 2014 17:26:38 GMT

I am stretching the limits of my knowledge of CSD guts but I am pretty sure
CSDs can't do that. They are only for managing services. Any code that you
want to be deployed will have to be in your parcel. It's fairly
straightforward to create a parcel. It's a tarball with some additional
metadata in it.

Here are a few good starting points:
http://blog.cloudera.com/blog/2013/05/faq-understanding-the-parcel-binary-distribution-format/
https://github.com/cloudera/cm_ext
https://github.com/cloudera/cm_ext/wiki/Building-a-parcel
https://github.com/cloudera/cm_ext/wiki/The%20parcel%20format
(Optional)
https://github.com/cloudera/cm_ext/wiki/The-parcel-repository-format

Re: Creating new Service using CSD-Custom Service descriptors

ramanaopensource — Sat, 20 Sep 2014 08:16:41 GMT

Thank You mgrover for all the answers.