Support Questions
Find answers, ask questions, and share your expertise

Mismatching permissions between HDFS and HDFS NFS gateway

Mismatching permissions between HDFS and HDFS NFS gateway

Rising Star

Using HDFS NFS gateway with HDP 3.1 and seeing odd behavior where directories accessed via NFS mount have permissions different that those of the local host user that created them (eg. via "hadoop fs -mkdir ..." and "... -chmod ..."command). Eg.

[etl@HW04 data]$ hadoop fs -ls /user Found 13 items 
drwx------   - myuser   hdfs            0 2019-07-19 13:53 /user/myuser
...
[etl@HW04 data]$
[etl@HW04 data]$ 
[etl@HW04 data]$ id uid=1026(myuser) gid=1026(myuser) groups=1026(myuser) context=system_u:system_r:unconfined_service_t:s0 
[etl@HW04 data]$
[etl@HW04 data]$
[etl@HW04 data]$ pwd 
/nfs_mount_path/etl/dept/data
[etl@HW04 data]$
[etl@HW04 data]$ 
[etl@HW04 data]$ ls -lh 
total 3.0K 
drwxr-xr-x.  2 882121447 882121447  64 Aug  2 15:34 error 
drwxr-xr-x.  2 882121447 882121447  64 Aug  5 09:49 processed 
drwxr-xr-x.  2 882121447 882121447  64 Aug  2 15:34 processing 
drwxrwxr-x. 31 882121447 882121447 992 Aug  5 09:56 raw 
drwxr-xr-x.  2 882121447 882121447  64 Aug  2 15:47 storage 
[etl@HW04 data]$
[etl@HW04 data]$
[etl@HW04 data]$ hadoop fs -ls /etl/dept/data 
Found 5 items 
drwxr-xr-x   - myuser myuser          0 2019-08-02 15:34 /etl/dept/data/error 
drwxr-xr-x   - myuser myuser          0 2019-08-05 09:49 /etl/dept/data/processed 
drwxr-xr-x   - myuser myuser          0 2019-08-02 15:34 /etl/dept/data/processing 
drwxrwxr-x   - myuser myuser          0 2019-08-05 09:56 /etl/dept/data/raw 
drwxr-xr-x   - myuser myuser          0 2019-08-02 15:47 /etl/dept/data/storage

So notice that the user exists on the client node used (as well as on the namenode), has a home directory in HDFS (and I assume this is all that is required on an unsecured cluster based on this other Hortonworks post: http://community.hortonworks.com/answers/15434/view.html with the addition of having the user exist on the cluster namenode), yet when accessing dirs that myuser owns via NFS gateway, the resulting permissions do not match those shown when accessing via "hadoop fs ..." commands and access is denied.

One example of how this affects operations is that I cannot use the normal FS commands from terminal to delete folders created by myuser. Seeing even further problems in that not even root on the local host is able to delete these NFS dirs or files.

Can anyone explain what this is? Any debugging suggestions or fixes?