Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Is it possible to configure Oozie job to run on a specific cluster VM?

Solved Go to solution
Highlighted

Is it possible to configure Oozie job to run on a specific cluster VM?

New Contributor

Dear all,

I am working on a cluster with several VM and I need to run some pyspark code through Oozie periodically on a specific cluster machine, however I am not able to find a configuration that allows me to do that.

My workarround so far is to run a ssh client session with oozie that will spark-submit the script. Is this the only way?

Thanks in advance

1 ACCEPTED SOLUTION

Accepted Solutions

Re: Is it possible to configure Oozie job to run on a specific cluster VM?

New Contributor

Actually you are not able to force the oozie action running in a certain node unless you are using ssh action. Once the Oozie submit the action to Yarn, Yarn will running the job in one of the NodeManger host.

2 REPLIES 2

Re: Is it possible to configure Oozie job to run on a specific cluster VM?

New Contributor

Actually you are not able to force the oozie action running in a certain node unless you are using ssh action. Once the Oozie submit the action to Yarn, Yarn will running the job in one of the NodeManger host.

Re: Is it possible to configure Oozie job to run on a specific cluster VM?

New Contributor

I will then keep it working with the ssh session.

Thank you very much for your feedback.