I have a requirement where we have to assign our CS queues based on ad groups.
For example our ad users are using cluster and running jobs under defined queue but I want that is there any way to configure their AD group with queue so that each member of that queue will go only to a specific queue.
Hello @Neeraj Sabharwal: Thanks for the above explanation. I have configured CS view which is working fine for local unix group and users. But when I configured for Ldap or AD group it does not work and fail with below error.
org.apache.tez.dag.api.TezException: org.apache.hadoop.yarn.exceptions.YarnException: Failed to submit application_1455533826426_0018 to YARN : Failed to submit application application_1455533826426_0018 submitted by user saurkuma reason: No groups found for user saurkuma
My only concern is if user is part of that group or not.
<property> <name>yarn.scheduler.capacity.queue-mappings</name> <value>u:maria:engineering,g:webadmins:weblog</value> </property>
Hi @Neeraj Sabharwal: when configured ad group mapping then I don't defined any user mapping.And yes user saurkuma is a part of adhdpadm group.
My first point is does it supports ldap groups(Active directory) or not ?
I checked with local unix groups and found them working.
@Saurabh Kumar You can see that I have mapped hdpadmin group to queue hadoopadmin
user neeraj is part of the group and when I run yarn job, it executes against hdpadmin queue
[root@phdns02 ~]# cat /etc/group | grep hdpadmin
[root@phdns02 ~]# su - neeraj
su: warning: cannot change directory to /home/neeraj: No such file or directory
exituid=29800018(neeraj) gid=29800018(neeraj) groups=29800018(neeraj),29800017(hdpadmin) context=unconfined_u:unconfined_r:unconfined_t:s0-s0:c0.c1023
[root@phdns02 ~]# id neeraj
uid=29800018(neeraj) gid=29800018(neeraj) groups=29800018(neeraj),29800017(hdpadmin)