- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Permission denied write group access help
- Labels:
-
Apache Hadoop
-
HDFS
Created on ‎12-15-2016 09:51 AM - edited ‎09-16-2022 03:51 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi everyone,
I'm a new user of HDP2.3. I have setup a cluster of 3 nodes (one name node and 2 datanodes).
How come linux user xdl <group:hadoop> can't write to hdfs directory /xdl/tests, owned by the exact same group hadoop?
Please help me to understand.
Created ‎12-15-2016 10:37 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Run "hdfs groups xdl3" ... this will show you the hdfs groups associated with that user. If xdl3 is not in the hadoop group in hdfs, then it will not be able to write under that directory.
To sync hdfs group mappings with linux group mappings:
1. Run "sudo useradd <username> -g <hadoop_gid>" on all 3 hadoop servers
2. Run "hdfs dfsadmin -refreshUserToGroupsMappings" on one of the servers
3. Run "hdfs groups xdl3" to view the change
Hope this helps
Created ‎12-15-2016 09:07 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
sudo su - hdfs, then execute your commands. the xdl3 user does not have write access to /xdl/tmp directory.
Also i hope you dont have any acls setup.
Created ‎12-15-2016 10:37 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Run "hdfs groups xdl3" ... this will show you the hdfs groups associated with that user. If xdl3 is not in the hadoop group in hdfs, then it will not be able to write under that directory.
To sync hdfs group mappings with linux group mappings:
1. Run "sudo useradd <username> -g <hadoop_gid>" on all 3 hadoop servers
2. Run "hdfs dfsadmin -refreshUserToGroupsMappings" on one of the servers
3. Run "hdfs groups xdl3" to view the change
Hope this helps
Created ‎12-16-2016 03:41 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Thanks for the workaround. This has solved my group-access problem.
