Member since
02-04-2016
132
Posts
52
Kudos Received
7
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
6462 | 07-25-2018 10:53 AM | |
1841 | 07-25-2018 05:15 AM | |
1903 | 10-03-2017 12:08 PM | |
3213 | 04-04-2017 05:36 AM | |
3503 | 11-29-2016 05:40 PM |
11-29-2016
12:15 PM
@Edgar Daeds Thank you for replying. Audit to DB is checked in Ambari. I also unchecked, saved and restarted, then checked again, saved and restarted - but still problem remains. Regarding using own values instead of variables - i'm not sure exactly what to enter and again - until the reboot it worked flawlessly.
... View more
11-29-2016
12:13 PM
@Sagar Shimpi
Thank you for replying.
I wanted to add that login sessions are being audited. It's just the Access information (Hive access) ism't audited.
I enabled debug as per your recommendation and restarted ranger but haven't found any errors regarding audit or connection to db.
There is an LDAP error:
DEBUG org.apache.ranger.security.handler.RangerAuthenticationProvider (RangerAuthenticationProvider.java:280) - AD Authentication Failed:
org.springframework.security.authentication.BadCredentialsException: Bad credentials But it doesn't say which user and i'm not sure it is related. Our Hive is configured for LDAP auth so maybe it is related.
... View more
11-29-2016
09:12 AM
Hello We use Ranger for auditing Hive.
Yesterday at 15:20 after restarting the Server that runs Ambari (Ambari audits to the default mysql which is on the same server) the auditing has stopped working.
Ranger is up & running, mysql is also running, plugins are working and synced with Hiveserver2.
Yet no data is being audited to he db since the reboot of the server. I've queried the xa_ranger_audit table and it shows entries up until the server reboot.
Clearly something imperative is not running. Any suggestions are appreciated !
... View more
Labels:
- Labels:
-
Apache Hive
-
Apache Ranger
11-09-2016
05:15 PM
It seems that Ranger 0.5 retrieves just the groups that hold the users that it synced. Empty groups are not retrieved. In Ranger 0.6 it is fixed. https://issues.apache.org/jira/browse/RANGER-869
... View more
11-09-2016
08:25 AM
@Sagar Shimpi
Thank you for replying. I've completed all configurations for group mapping as described in the document, and group mapping works. The problem is that usersync does not import groups from LDAP. Just users and creates their groups as internal.
This means that groups from ldap which have no users (new groups) are unavailable in Ranger. I can't attach the logs because they hold names and addresses from out production environment, however i can attach the beginning of the log file which shows the values for usersync and i can tell you that there are no errors in the log. Here is the problem in screenshots: Users from Active Directory and their respectable groups: Groups are only "internal" No external groups: The begining of the log (i did change some of the OU names for privacy reasons): 09 Nov 2016 09:21:19 INFO UserGroupSync [UnixUserSyncThread] - initializing source: org.apache.ranger.ldapusersync.process.LdapUserGroupBuilder
09 Nov 2016 09:21:19 INFO UserGroupSync [UnixUserSyncThread] - Begin: initial load of user/group from source==>sink
09 Nov 2016 09:21:19 INFO LdapUserGroupBuilder [UnixUserSyncThread] - LDAPUserGroupBuilder updateSink started
09 Nov 2016 09:21:19 INFO LdapUserGroupBuilder [UnixUserSyncThread] - LdapUserGroupBuilder initialization started
09 Nov 2016 09:21:19 INFO LdapUserGroupBuilder [UnixUserSyncThread] - LdapUserGroupBuilder initialization completed with -- ldapUrl: ldap://<myldapserver>:389, ldapBindDn: CN=<ldapuser>,OU=<blabla>,OU=Users,OU=Administration,DC=corp,DC=cellcom,DC=co,DC=il, ldapBindPassword: ***** , ldapAuthenticationMechanism: simple, searchBase: OU=Administration,DC=corp,DC=cellcom,DC=co,DC=il, userSearchBase: OU=<usersOU>,OU=<parentou>,OU=Organization,OU=Administration,DC=corp,DC=cellcom,DC=co,DC=il, userSearchScope: 2, userObjectClass: person, userSearchFilter: objectclass=top, extendedUserSearchFilter: (&(objectclass=person)(objectclass=top)), userNameAttribute: sAMAccountName, userSearchAttributes: [sAMAccountName, ismemberof, memberof], userGroupNameAttributeSet: [ismemberof, memberof], pagedResultsEnabled: true, pagedResultsSize: 500, groupSearchEnabled: true, groupSearchBase: OU=<ouforgroups>,OU=<parentou>,DC=corp,DC=cellcom,DC=co,DC=il, groupSearchScope: 2, groupObjectClass: group, groupSearchFilter: , extendedGroupSearchFilter: (&(objectclass=group)(member={0})), extendedAllGroupsSearchFilter: (&(objectclass=group)), groupMemberAttributeName: member, groupNameAttribute: distinguishedName, groupUserMapSyncEnabled: true, ldapReferral: ignore
I would expect usersync to import groups from the groups OU thanks to the following: groupSearchEnabled: true, groupSearchBase: OU=<ouforgroups>,OU=<parentou>,DC=corp,DC=cellcom,DC=co,DC=il, Any ideas ?
... View more
11-08-2016
02:29 PM
Hello experts We have HDP 2.3.2 with Ranger 0.5 that is configured to sync users & groups from Active Directory.
SSSD is configured in all machines. ranger.usersync.ldap.user.searchbase & ranger.usersync.group.searchbase are configured to the relevant OUs. Usersync does sync users and maps to their AD groups without a problem. I'm able to grant users permissions using Ranger but i'd rather manage groups and not users. When i search for groups in Ranger i can only see groups that have been mapped from the synced users - and not all the groups in the ranger.usersync.group.searchbase OU.
Bottom line, usersync syncs only users & their own groups - but not groups that are in the anger.usersync.group.searchbase OU. All groups in Ranger are from source "Internal" and none "external". I've set the following values under "Advanced ranger-ugsync-site": ranger.usersync.ldap.user.groupnameattribute ranger.usersync.group.nameattribute ranger.usersync.group.searchbase ranger.usersync.group.searchenabled = true ranger.usersync.group.usermapsyncenabled = true Any ideas why usersync does not sync the groups ? Regards, Adi
... View more
Labels:
- Labels:
-
Apache Ranger
11-02-2016
04:32 PM
I've noticed that in the new Edge running the HiveServer2 in /etc/hive/conf/conf.server the ranger-hive-audit.xml & ranger-hive-security.xml were configured with localhost values. Fixed the issue by setting the server name instead of localhost in Ranger settings (Ambari)
(External URL, authServiceHostName etc.) Now the new server can contact the Ranger and Hive is working.
Thank you for the heads up !
... View more
11-02-2016
06:58 AM
@Neeraj Sabharwal @srai Thanks for the observation, i haven't considered this as a Ranger issue because it says that Access is allowed.. Anyways - disabling Ranger plugin fixed the issue.... but i need the Ranger plugin so i could manage Hive authorizations using Ranger. Can't i use two HiveServer2 instances while managing hive auth using Ranger ??
... View more
11-01-2016
04:28 PM
When i'm connected to the additional hiveserver and run beeline >>> show tables i get no tables In the log it says: 2016-11-01 12:11:59,214 INFO [HiveServer2-Background-Pool: Thread-165]: HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(372)) - ugi=adijaip=unknown-ip-addr cmd=get_tables: db=default pat=.*
2016-11-01 12:11:59,229 WARN [HiveServer2-Background-Pool: Thread-165]: security.UserGroupInformation (UserGroupInformation.java:getGroupNames(1521)) - No groups available for user adija
2016-11-01 12:11:59,230 ERROR [HiveServer2-Background-Pool: Thread-165]: authorizer.RangerHiveAuthorizer (RangerHiveAuthorizer.java:filterListCmdObjects(430)) - filterListCmdObjects: Internal error: null RangerAccessResult object received back from isAccessAllowed()!
... View more
11-01-2016
07:24 AM
Hello I have a cluster (HDP 2.3.2) with one edge node serving as Hive Server (running hiveserver2).
This server is used for Hive ETL processes and also for end users that query the hive databases.
Because this server is very busy i want to add another edge server that will be dedicated for the ETL processes, thus ending up with one edge node for ETL processes (that insert data to Hive tables), and a different edge node that serves end users for querying the same hive tables.
I've added the new host to the cluster, ran the add HiveServer2 wizard.
The Amabri shows everything is up and running.
When i login to the new edge node, run "beeline" and login to hive but i can't see the tables in my old hive metastore. It is as if these are two completely separate instances. I need two different servers looking at the same Hive metastore\DB.
Any ideas how can i acomplish this ?
... View more
Labels:
- Labels:
-
Apache Ambari
-
Apache Hive