Member since
08-13-2015
5
Posts
0
Kudos Received
0
Solutions
04-10-2018
03:12 PM
@Saurabh Saurabh, have you check the following HCC article to see if it applies to your case? https://community.hortonworks.com/articles/16144/write-or-append-failures-in-very-small-clusters-un.html
... View more
04-09-2018
06:29 AM
@Saurabh, There seem to be 2 different issues at hand. 1) Make sure the user ID of all users is same across all nodes in the cluster (else, this will cause conflicts, as the NFS permissions configuration usage both the username, userID and groupID) so, as you can see above in ur descreiption -
uid 0594903//where 0 is uid of root on another machine, and 594903 is uid of hdfs which is superuser on datanode machine where NFS gateway is running. This is cause by the same reason, so better you can keep 0 to root, and update the userID for HDFS (but once you do that, you need to update lot of directories to map to the new uid of HDFS user), not sure how complicated this might get, but has to be done. 2) Make sure the user you want to change the ownership too (chown), is part of the config file given when you changed the defualt.fs to NFS. The files (in my case it was user.json and group.json) mentions each user and it's user id (in user.txt), and also the group that all users we want to configure for NFS, goes to groups.txt (group name, and it's id) Example entry in users.json: {
"userName":"root",
"userID":"0"
} Example entry in groups.json: {
"groupName":"root",
"groupID":"0"
} Also, for you to run the 'chown' command, make sure you are doing this as hdfs user (from your above log, it seems only hdfs user can do this). Hope this helps.
... View more