Support Questions
Find answers, ask questions, and share your expertise
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Bigdata Continuous Delivery

Solved Go to solution

Re: Bigdata Continuous Delivery


Hello Everyone,

We are using scala with maven to build spark applications along with git as code repository and jenkins integrated with git to build the jar.

I am not sure how to use jenkins to deploy our apps on cluster.

Can anyone explain what could be the next step?

Is jenkins supporting deployment of spark apps like it does for other apps.

Tha ks


Re: Bigdata Continuous Delivery

New Contributor

Dear @Fabricio Carboni:

Can you please share some document on how we can implement CI/CD for pyspark based applications. Also, is it possbile to do it without using containers (like we do development in Java/Scala (first locally on windows and then build it on Linux dev/tst/Prod))



Re: Bigdata Continuous Delivery

New Contributor

Hi, Were you able to find a solution to this? We have a similar setup and I can't seem to find any examples of that.

Don't have an account?
Coming from Hortonworks? Activate your account here