Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Yarn node-labels are getting deleted after yarn restart

Yarn node-labels are getting deleted after yarn restart

New Contributor

I have created 2 node labels in yarn using the below commands but when I restart yarn these lables are getting deleted.

 

yarn rmadmin -addToClusterNodeLabels x,y

yarn rmadmin -replaceLabelsOnNode "node1.app.org,x node2.app.org,y node3.app.org,y"

 

1 REPLY 1
Highlighted

Re: Yarn node-labels are getting deleted after yarn restart

Master Guru
What have you specified as your Node Labels storage directory in your global yarn-site.xml file, via property "yarn.node-labels.fs-store.root-dir"?

The default for this property uses a local filesystem /tmp/ generated directory that can get cleaned up periodically or at boot, and also not exist in sync between HA ResourceManager hosts.

Try specifying a HDFS location for it and perform your modification tests again, as described at https://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/NodeLabel.html#Configuration