Skip to main content
NumeroUnoNU
NumeroUnoNU
Silver ⭐️⭐️⭐️
June 12, 2020
Solved

Deploy own service on Cloudera

HI,

 

I am trying to install a custom service on Cloudera. This service requires some libs for it to run.

I have created the CSD sdl and control.sh file and created a jar out of it.

 

The issue is that I am not getting where to put service libs in Cloudera. Should these be bundled in CSD jar itself? or should these be installed as parcel. If as parcel, how to install it. I do not see much doc on installing/deploying local parcel on Cloudera manager.

 

Please help. 

Bender
BenderAnswer
Gold ⭐️⭐️⭐️
June 24, 2020

Hello @NumeroUnoNU ,

 

yes, you either parse the contents of the hdfs-site.xml or you utilise the HDFS Client, so you do not need to worry about implementation details. I've just quickly googled for you an explanation of what is HDFS Client [1]. If you go for the parsing exercise, make sure you are not referencing the NN, otherwise on failover you should prepare your script to handle that situation.

 

Kind regards:

Ferenc

 

[1] https://stackoverflow.com/questions/43221993/what-does-client-exactly-mean-for-hadoop-hdfs

Ferenc Erdelyi, Technical Solutions Manager Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button. Learn more about the Cloudera Community: - Community Guidelines (https://community.cloudera.com/t5/custom/page/page-id/Community_Guidelines) - How to use the forum (/t5/help/faqpage)
View in thread

11 replies

NumeroUnoNU
NumeroUnoNUAuthor
Silver ⭐️⭐️⭐️
June 14, 2020

Any help here please?

Translate
Bender
Gold ⭐️⭐️⭐️
Bender
Gold ⭐️⭐️⭐️
June 15, 2020

Hello @NumeroUnoNU ,

 

thank you for raising your enquiries about how to build a CSD. Have you seen the github repo [1] along with the instructions on how to build and deploy your custom solution, please?

Please note the side-menu on the right with the links of the different instructions on e.g. how to build a parcel, how to create control scripts and so on.

 

Please let us know if you found the information on our github repo that you were looking for!

 

Thank you:

Ferenc

 

[1] https://github.com/cloudera/cm_ext/wiki/CSD-Overview

Translate
Ferenc Erdelyi, Technical Solutions Manager Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button. Learn more about the Cloudera Community: - Community Guidelines (https://community.cloudera.com/t5/custom/page/page-id/Community_Guidelines) - How to use the forum (/t5/help/faqpage)
NumeroUnoNU
NumeroUnoNUAuthor
Silver ⭐️⭐️⭐️
June 15, 2020

Thanks Bender, I will take a look.

Translate
NumeroUnoNU
NumeroUnoNUAuthor
Silver ⭐️⭐️⭐️
June 20, 2020

This works out. Thanks.

One more question, is there any environment variable that I can use in my control script to get the webhdfs url?

Translate
Terms & ConditionsAccessibility statement