Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Creating new Service using CSD-Custom Service descriptors

avatar

Hi,

I am working on creating new servive using CSD. I am able to create basic CSD by following the URL https://github.com/cloudera/cm_ext/wiki/CSD-Overview

 

For this service, we would like to create UI similar to Spark service Master Web UI which runs on 18080. How to create this UI ?

 

Is this UI code is part of Spark CSD ?

 

any help will be appreciated.

 

Thanks,
Ramana.

 

1 ACCEPTED SOLUTION

avatar
Expert Contributor
I am stretching the limits of my knowledge of CSD guts but I am pretty sure
CSDs can't do that. They are only for managing services. Any code that you
want to be deployed will have to be in your parcel. It's fairly
straightforward to create a parcel. It's a tarball with some additional
metadata in it.

Here are a few good starting points:
http://blog.cloudera.com/blog/2013/05/faq-understanding-the-parcel-binary-distribution-format/
https://github.com/cloudera/cm_ext
https://github.com/cloudera/cm_ext/wiki/Building-a-parcel
https://github.com/cloudera/cm_ext/wiki/The%20parcel%20format
(Optional)
https://github.com/cloudera/cm_ext/wiki/The-parcel-repository-format

View solution in original post

6 REPLIES 6

avatar
Expert Contributor
Hi Ramana,
The Spark Master Web UI is from the Spark project. The CSD doesn't have the
code for it. If you want a similar UI, you are probably better off looking
at how say the Hadoop Namenode UI or the Spark master UI is written.

avatar

Hi mgrover,

 

Thanks for the answer.

 

I thought of that. My question is if we are installing Spark using CSD, then Spark CSD jar contains the code for UI as well ? I don't any UI code in the Spark CSD implementaion provided here https://github.com/cloudera/cm_csds/tree/master/SPARK

 

So, When the spark is installed through CSD, How the UI code will be deployed ?

 

Thanks,

Ramana.

 

avatar
Expert Contributor
Hi Ramana,
What UI code are you referring to? Assuming you are referring to the Spark
Master UI (and not the Cloudera Manager UI), that code is a part of Spark
binaries that are delivered as a part of the CDH parcel.

avatar

Yes. I am referring to Spark Master UI.

 

My requirement is to create test service using CSD and need to have something similar to Spark Master UI for this new service. In the new service UI, I need to display custom configurations related to the new service.

 

In this case, Is it possible to do this using CSD only ?

 

Or I need to have parcels for my new service. How is easy to create parcels for new service ?

 

Thanks,

Ramana.

 

 

 

avatar
Expert Contributor
I am stretching the limits of my knowledge of CSD guts but I am pretty sure
CSDs can't do that. They are only for managing services. Any code that you
want to be deployed will have to be in your parcel. It's fairly
straightforward to create a parcel. It's a tarball with some additional
metadata in it.

Here are a few good starting points:
http://blog.cloudera.com/blog/2013/05/faq-understanding-the-parcel-binary-distribution-format/
https://github.com/cloudera/cm_ext
https://github.com/cloudera/cm_ext/wiki/Building-a-parcel
https://github.com/cloudera/cm_ext/wiki/The%20parcel%20format
(Optional)
https://github.com/cloudera/cm_ext/wiki/The-parcel-repository-format

avatar

Thank You mgrover for all the answers.