AccessDeniedException : /opt/yarn/nm/usercache/user/appcache/application_123123

[#1]

Hi,

I keep getting this access denied even though i'm changing the permission of the directory of /opt/yarn/nm/usercache/

this is encountered upon doing some select query with joins

AccessDeniedException : /opt/yarn/nm/usercache/user/appcache/application_123123_00/blockmgr-clel77710/0a/shuffle_5_1_0.index

How can I fix it permanently?

[#2]

Hi,

May be the permissions are messed up can you try the following steps and see whether it helps.

1. Stop the YARN service.
2. Log in to all nodes and delete the content of the usercache directories.
3. Verify all usercache directories on all nodes are empty.
4. Start the YARN service.

[#3]

If you keep seeing this, check in the bash profile on all nodes, if the umask is set to something else. It should be 0022.