question Re: Load balancing in oozie in Archives of Support Questions (Read Only)

Load balancing in oozie

Bhagaban — Fri, 16 Sep 2022 09:25:47 GMT

Hello,

Wanted to know if Oozie will do load balancing internally.

Requirement is we have around 200-500 shell script and which will run from different node in the cluster but we dont know how it will schedule internally. Will it do load balancing automatic if one node will have many loads on that perticular machin.

Please advice.

Re: Load balancing in oozie

Harsh J — Wed, 01 Apr 2015 07:30:26 GMT

Oozie actions (such as shell, java, etc.) are launched as regular
(1-map) MR jobs, so YARN (or JobTracker, if MR1) usually takes care of
resource management for Oozie workflows in the cluster.

Re: Load balancing in oozie

Bhagaban — Thu, 02 Apr 2015 07:40:04 GMT

Harsh,

Sorry to asking you again on this. I am really in a odd situation. lets say I have 100 scripts which will fire from one node via oozie. Then how it will re-direct to other node (load balancing), I have heard about fair scheduler but need your help to undertsand it completely. Will fair scheduler will send the data across all nodes.

Please help