Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

YARN-local cache clean up

Highlighted

YARN-local cache clean up

Hi,

How do I clean YARN local cache. My entire disk space is occupied by this.

I changed several things in my yarn config file via ambari.

yarn.nodemanager.localizer.cache.cleanup.interval-ms600000Interval in between cache cleanups.
yarn.nodemanager.localizer.cache.target-size-mb10240Target size of localizer cache in MB, per local directory.

I can't get any imprvement so far.

#cd /usr/hadoop/yarn/local

#ls

filecache

nmPrivate

usercache

#du -h

63G

Thanks,

Radhakrishnan Rk

3 REPLIES 3
Highlighted

Re: YARN-local cache clean up

Super Guru

have you tried running

yarn scmadmin -runCleanerTask

?

Highlighted

Re: YARN-local cache clean up

Contributor

@Radhakrishnan Rk

If the above mentioned configs doesn't work you can directly delete the folders under /usr/hadoop/yarn/local and restart the Nodemanager

Highlighted

Re: YARN-local cache clean up

Rising Star

@Radhakrishnan Rk The local dirs should be cleaned up at completion of a job. This can be problematic if an RM restart is done and leaves orphaned files over time. In that case, I would refer to @nshetty comment to manually clean up those locations.

Don't have an account?
Coming from Hortonworks? Activate your account here