Support Questions

Find answers, ask questions, and share your expertise

HDFS user group mapping with AD

avatar
Super Collaborator

users connect to Hive through Knox uses AD credentials...integrated HDFS with AD groups... now HDFS is not able to recognize local user groups.

1 ACCEPTED SOLUTION

avatar

There is a group mapping provider called CompositeGroupsMapping, which is capable of combining the groups returned from multiple other group mapping providers. The user's effective group memberships are then the union of all groups returned from the underlying group mapping providers. You could potentially set up CompositeGroupsMapping to combine results from AD and the local user database.

Unfortunately, I don't believe there is any step-by-step documentation available that discusses CompositeGroupsMapping. Instead, you'd need to review Apache JIRA HADOOP-8943 and the attached patch to see how it works. There are also comments in core-default.xml that show example usage.

https://github.com/apache/hadoop/blob/release-2.7.1/hadoop-common-project/hadoop-common/src/main/res...

View solution in original post

1 REPLY 1

avatar

There is a group mapping provider called CompositeGroupsMapping, which is capable of combining the groups returned from multiple other group mapping providers. The user's effective group memberships are then the union of all groups returned from the underlying group mapping providers. You could potentially set up CompositeGroupsMapping to combine results from AD and the local user database.

Unfortunately, I don't believe there is any step-by-step documentation available that discusses CompositeGroupsMapping. Instead, you'd need to review Apache JIRA HADOOP-8943 and the attached patch to see how it works. There are also comments in core-default.xml that show example usage.

https://github.com/apache/hadoop/blob/release-2.7.1/hadoop-common-project/hadoop-common/src/main/res...