question Re: Changing YARN local directory safely in Archives of Support Questions (Read Only)

Changing YARN local directory safely

jmillette — Fri, 16 Sep 2022 09:48:49 GMT

Hi all.

Scenario: Yarn has two local directories on different partitions. One of those partitions has filled due to me undersestimating how much disk yarn would need. The NM is now in a critical health state even though the second partition has a pile of free space.

Can I just remove the first partition from the config and restart the service to force it to use the other without breaking stuff?

Re: Changing YARN local directory safely

Harsh J — Tue, 10 Nov 2015 05:43:17 GMT

A YARN NM does not persist any vital data. While it does persist some running container states (for restart recovery purposes), most of these containers can be retried by their applications (such as MR2 and Spark) so their transient data directories are not important to keep across restarts.

> Can I just remove the first partition from the config and restart the service to force it to use the other without breaking stuff?

Yes, this would be safe to perform.

Re: Changing YARN local directory safely

jmillette — Tue, 10 Nov 2015 14:54:52 GMT

Many thanks! I will perform this operation.