07-24-2018 12:36 AM - last edited on 07-24-2018 07:21 AM by cjervis
I just enable Kerberos on my test cluster, however after enabling kerberos, I am not able to create /user/test directory anymore due to permission error.
hadoop fs -mkdir /user/test
mkdir: Permission denied: user=admin, access=WRITE, inode="/user":hdfs:supergroup:drwxr-xr-x
Anyway to fix it?
07-24-2018 12:15 PM
The Permission Denied message indicates that your hadoop command is authenticating as the user "admin". As you can see, the user "admin" does not have previlige to write to the /user directory.
In order to be able to have non-hdfs user write to that /user directory with the permissions as they are, that "admin" user will need to be a superuser.
If you are not interested in having outher users as superusers, then the other option is to kinit as hdfs
Basically, you need to create a user in your KDC with the name "hdfs" and with the userprincipalname hdfs@realm.
See this page for details all that I mentioned above:
07-27-2018 12:17 AM
It does the trick by creating hdfs user in kerberos, however, for the proper setup do I need to change the supergroup? and assign user to supergroup?