yarm RM and NM on same node

[#1]

Hi All,

Is it suggested to have both the Resource Manager and Node Manager on the same nodes? Cluster is with 51 nodes and each node is 512Gb of memory. 

Thanks,

Raghu.

[#2]

Hi @raghu9raghavend ,

Here is a reference to a topological layout of Cloudera roles:

https://docs.cloudera.com/documentation/enterprise/latest/topics/cm_ig_host_allocations.html#concept...

I hope this helps.

Regards,

Steve

[#3]

Thanks @StevenOD. we have a similar layout. But more jobs are adding to the cluster every day, as a result, there are some resource constraints. we are not expanding the cluster this year, hence searching for other routes like adding NM on top of RM and NN. Is it good to add NM on the Master nodes where NN and RM are hosted?

Thanks,

Raghu. 

[#4]

Hi @raghu9raghavend ,

I wouldn't recommend putting the node manager on the master nodes. You want the node managers to run where the data are stored. So putting the node manager on the master nodes implies that you would also be using the master nodes as data nodes. Ideally, you want to isolate the master nodes and services that manage the platform out from where the computation and processing are happening i.e. the data nodes.

Regards,

Steve