Community Articles

Find and share helpful community-sourced technical articles.
Labels (2)
avatar
Contributor

To clear local file cache and user cache for yarn, perform the following:

  1. Find out the cache location by checking the value of the yarn.nodemanager.local-dirs property :
    <property>       
    <name>yarn.nodemanager.local-dirs</name>       
    <value>/hadoop/yarn/local</value> 
    </property>
  2. Remove filecache and usercache folder located inside the folders that is specified in yarn.nodemanager.local-dirs.
    [yarn@node2 ~]$ cd /hadoop/yarn/local/ 
    [yarn@node2 local]$ ls filecache  nmPrivate  spark_shuffle  usercache 
    [yarn@node2 local]$ rm -rf filecache/ usercache/
    If there are more than one folder, clean them one by one.
  3. Restart YARN service.
36,044 Views