Support Questions

Find answers, ask questions, and share your expertise

How to configure multiple node labels in one node using yarn capacity scheduler

avatar
Rising Star

Trying to configure multiple node labels(RackA,RackB) in one node(node2) using yarn capacity scheduler using below command. But it isnt working. Kindly help me with this.

yarn rmadmin -replaceLabelsOnNode "node1:port=RackA node2:port=RackA,RackB"

1 ACCEPTED SOLUTION

avatar
Super Guru

@Gaurab D

A single node label can have multiple nodes assigned to it. However, a single node can not belong to more than 1 node label. You are trying to label a single node with 2 different labels which is not supported.

See: https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.4.0/bk_yarn_resource_mgt/content/configuring_no...

You can only assign one node label to each node. Also, if you do not specify a port, the node label change will be applied to all NodeManagers on the host.

View solution in original post

3 REPLIES 3

avatar
Super Guru

Which version of Hadoop are you using? there was an issue that was in fixed in version 2.6 which might be impacting you.

https://issues.apache.org/jira/browse/YARN-2723

and what's the error are you getting? Can you please share that?

avatar
Rising Star

we were using Hadoop 2.7.1.2.4.2.0-258

avatar
Super Guru

@Gaurab D

A single node label can have multiple nodes assigned to it. However, a single node can not belong to more than 1 node label. You are trying to label a single node with 2 different labels which is not supported.

See: https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.4.0/bk_yarn_resource_mgt/content/configuring_no...

You can only assign one node label to each node. Also, if you do not specify a port, the node label change will be applied to all NodeManagers on the host.