Reply
Highlighted
New Contributor
Posts: 4
Registered: ‎10-24-2018

Yarn node-labels are getting deleted after yarn restart

[ Edited ]

I have created 2 node labels in yarn using the below commands but when I restart yarn these lables are getting deleted.

 

yarn rmadmin -addToClusterNodeLabels x,y

yarn rmadmin -replaceLabelsOnNode "node1.app.org,x node2.app.org,y node3.app.org,y"

 

Posts: 1,903
Kudos: 435
Solutions: 307
Registered: ‎07-31-2013

Re: Yarn node-labels are getting deleted after yarn restart

What have you specified as your Node Labels storage directory in your global yarn-site.xml file, via property "yarn.node-labels.fs-store.root-dir"?

The default for this property uses a local filesystem /tmp/ generated directory that can get cleaned up periodically or at boot, and also not exist in sync between HA ResourceManager hosts.

Try specifying a HDFS location for it and perform your modification tests again, as described at https://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/NodeLabel.html#Configuration