question Re: Is it possible to configure Oozie job to run on a specific cluster VM? in Archives of Support Questions (Read Only)

Is it possible to configure Oozie job to run on a specific cluster VM?

saulo_sobreiro — Tue, 23 May 2017 00:57:12 GMT

Dear all,

I am working on a cluster with several VM and I need to run some pyspark code through Oozie periodically on a specific cluster machine, however I am not able to find a configuration that allows me to do that.

My workarround so far is to run a ssh client session with oozie that will spark-submit the script. Is this the only way?

Thanks in advance

Re: Is it possible to configure Oozie job to run on a specific cluster VM?

xin_wang — Fri, 02 Jun 2017 00:59:22 GMT

Actually you are not able to force the oozie action running in a certain node unless you are using ssh action. Once the Oozie submit the action to Yarn, Yarn will running the job in one of the NodeManger host.

Re: Is it possible to configure Oozie job to run on a specific cluster VM?

saulo_sobreiro — Sat, 03 Jun 2017 23:40:35 GMT

I will then keep it working with the ssh session.

Thank you very much for your feedback.