Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Reduce program hosting location

Solved Go to solution
Highlighted

Reduce program hosting location

New Contributor

Documentation says, map tasks are run in DataNodes and have data locality constraints which the scheduler tries to honor and reduce tasks can run anywhere in the cluster. The statement "can run anywhere in the cluster" for reduce tasks, is referring to only DataNodes in the cluster OR is ResourceManager machine also considered part of the cluster, so that Reduce tasks are allowed to run in ResourceManager also ??

1 ACCEPTED SOLUTION

Accepted Solutions

Re: Reduce program hosting location

New Contributor

reduce tasks "can run anywhere in the cluster" means on any of the node which has "Node Manager" installed on it

3 REPLIES 3

Re: Reduce program hosting location

New Contributor

reduce tasks "can run anywhere in the cluster" means on any of the node which has "Node Manager" installed on it

Re: Reduce program hosting location

Super Guru
@Fasil Ahamed

"can run anywhere in the cluster" - Meaning anywhere where nodemanagers have been deployed, it can be any slave node or master node if nodemanager is installed on master nodes.

Hope this information helps!

Please do let me know if you have any further question.

Re: Reduce program hosting location

Super Guru

@Fasil Ahamed - Can you please accept the appropriate answer?