Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Clear YARN usercache?

Clear YARN usercache?

Explorer

Running the CDH 5.3.0 Quickstart VM; submitted a MR job and it was just sitting in YARN with no indication of progress.

 

http://quickstart.cloudera:8088/cluster/

 

Cloudera Manager shows lots of systems with log out of space errors so I looked through the filesystem for where I could free up space; found what appears to be excessive usage in the YARN usercache folder (6 GB in use).

 

File location is:

/yarn/nm/usercache/[user]/filecache

 

Can I just delete the cache manually or is there a better way?  Is there a way to configure YARN to use less space?

 

 

 

 

2 REPLIES 2

Re: Clear YARN usercache?

Super Collaborator

@dr3x did you check the inodes

 

Run the commnad df -i on your server and  make sure you don't have an issue with the inodes.

Highlighted

Re: Clear YARN usercache?

Champion

Since you have already found the culprit I would recommend you to go  go into CM and adjust the log retention settings for that service.

 

or 

 enable automatic yarn cache cleanup 

yarn.nodemanager.localizer.cache.cleanup.interval-ms is 600000

also check your 

 

"yarn.nodemanager.localizer.cache.target-size-mb