- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Load balancing in oozie
- Labels:
-
Apache Oozie
Created on 04-01-2015 12:16 AM - edited 09-16-2022 02:25 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hello,
Wanted to know if Oozie will do load balancing internally.
Requirement is we have around 200-500 shell script and which will run from different node in the cluster but we dont know how it will schedule internally. Will it do load balancing automatic if one node will have many loads on that perticular machin.
Please advice.
Created 04-01-2015 12:30 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
(1-map) MR jobs, so YARN (or JobTracker, if MR1) usually takes care of
resource management for Oozie workflows in the cluster.
Created 04-01-2015 12:30 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
(1-map) MR jobs, so YARN (or JobTracker, if MR1) usually takes care of
resource management for Oozie workflows in the cluster.
Created 04-02-2015 12:40 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Harsh,
Sorry to asking you again on this. I am really in a odd situation. lets say I have 100 scripts which will fire from one node via oozie. Then how it will re-direct to other node (load balancing), I have heard about fair scheduler but need your help to undertsand it completely. Will fair scheduler will send the data across all nodes.
Please help