Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

HDFS Files owner name has AD domain name

avatar
Contributor

Hi All,

Is there a way to only make AD username as the owner of HDFS files/directories instead of userName@domainName.

Current Scenario :

hdfs dfs -ls /testfile
-rw-r--r-- 3 dgiri@mytestdomain.com  hdfs         0 2017-06-30 10:06 /testfile

I want this to be like below.

hdfs dfs -ls /testfile
-rw-r--r-- 3 dgiri  hdfs         0 2017-06-30 10:06 /testfile

Please note that cluster is AD integrated and everything is working fine as expected except the files/directories ownership.

Also, I'm getting below INFO message whenever I run hdfs commands. Is there a way to stop displaying below message ?

17/09/19 12:50:13 INFO util.KerberosName: No auth_to_local rules applied to dgiri@mytestdomain.com

Any help is much appreciated.

Thanks.

1 ACCEPTED SOLUTION

avatar
Expert Contributor

You will need to add auth_to_local rule in core-site.xml to map dgiri@mytestdomain.com to dgiri

RULE:[2:$1](.*@mytestdomain.com)s/@.*//

More defailt of how to write auth_to_local rules can be found here: https://hortonworks.com/blog/fine-tune-your-apache-hadoop-security-settings/

View solution in original post

2 REPLIES 2

avatar
Expert Contributor

You will need to add auth_to_local rule in core-site.xml to map dgiri@mytestdomain.com to dgiri

RULE:[2:$1](.*@mytestdomain.com)s/@.*//

More defailt of how to write auth_to_local rules can be found here: https://hortonworks.com/blog/fine-tune-your-apache-hadoop-security-settings/

avatar
Contributor

Thanks @Xiaoyu Yao for the details and documentation link.