Reply
Explorer
Posts: 16
Registered: ‎06-19-2014

Clear YARN usercache?

Running the CDH 5.3.0 Quickstart VM; submitted a MR job and it was just sitting in YARN with no indication of progress.

 

http://quickstart.cloudera:8088/cluster/

 

Cloudera Manager shows lots of systems with log out of space errors so I looked through the filesystem for where I could free up space; found what appears to be excessive usage in the YARN usercache folder (6 GB in use).

 

File location is:

/yarn/nm/usercache/[user]/filecache

 

Can I just delete the cache manually or is there a better way?  Is there a way to configure YARN to use less space?

 

 

 

 

Expert Contributor
Posts: 200
Registered: ‎01-25-2017

Re: Clear YARN usercache?

@dr3x did you check the inodes

 

Run the commnad df -i on your server and  make sure you don't have an issue with the inodes.

Champion
Posts: 281
Registered: ‎05-16-2016

Re: Clear YARN usercache?

Since you have already found the culprit I would recommend you to go  go into CM and adjust the log retention settings for that service.

 

or 

 enable automatic yarn cache cleanup 

yarn.nodemanager.localizer.cache.cleanup.interval-ms is 600000

also check your 

 

"yarn.nodemanager.localizer.cache.target-size-mb
Announcements