Created on 12-15-2016 09:51 AM - edited 09-16-2022 03:51 AM
Hi everyone,
I'm a new user of HDP2.3. I have setup a cluster of 3 nodes (one name node and 2 datanodes).
How come linux user xdl <group:hadoop> can't write to hdfs directory /xdl/tests, owned by the exact same group hadoop?
Please help me to understand.
Created 12-15-2016 10:37 PM
Run "hdfs groups xdl3" ... this will show you the hdfs groups associated with that user. If xdl3 is not in the hadoop group in hdfs, then it will not be able to write under that directory.
To sync hdfs group mappings with linux group mappings:
1. Run "sudo useradd <username> -g <hadoop_gid>" on all 3 hadoop servers
2. Run "hdfs dfsadmin -refreshUserToGroupsMappings" on one of the servers
3. Run "hdfs groups xdl3" to view the change
Hope this helps
Created 12-15-2016 09:07 PM
sudo su - hdfs, then execute your commands. the xdl3 user does not have write access to /xdl/tmp directory.
Also i hope you dont have any acls setup.
Created 12-15-2016 10:37 PM
Run "hdfs groups xdl3" ... this will show you the hdfs groups associated with that user. If xdl3 is not in the hadoop group in hdfs, then it will not be able to write under that directory.
To sync hdfs group mappings with linux group mappings:
1. Run "sudo useradd <username> -g <hadoop_gid>" on all 3 hadoop servers
2. Run "hdfs dfsadmin -refreshUserToGroupsMappings" on one of the servers
3. Run "hdfs groups xdl3" to view the change
Hope this helps
Created 12-16-2016 03:41 AM
Thanks for the workaround. This has solved my group-access problem.