Member since
09-12-2017
6
Posts
0
Kudos Received
0
Solutions
03-26-2018
03:31 AM
Hi Tricky part is that some users (with same permission) can see tables and some cannot like me. We are using sssd, i have restarted it and did "id userid" command. Groups appear correct but still no hive tables.
... View more
03-26-2018
01:03 AM
also in default using impala, i can see table but can't see them in Hive
... View more
03-26-2018
12:59 AM
here is impala screenshot showing the databases. no databases appears in hive.
... View more
03-26-2018
12:24 AM
HI Guys
I am using sentry with hive/impala CDH version 5.10
Secured via AD kerberos and AD group.
Access to tables is done via sentry, and all users can see correct databases in impala as per grant option but some users cannot see the same tables in Hive.
Hive.
... View more
Labels:
- Labels:
-
Apache Hive
-
Apache Impala
-
Kerberos
10-24-2017
12:45 AM
this has been resolve, UDFs are the best. I wrote java and C++ codes, they check the current user. if user is not classified, data is masked for classified users it appear as is. --final steps is to create UFS eg hrmask --create a view with sensitive column preffixed with mask function. [localhost.localdomain:21000] > create view redact_m as select Title,GivenName,Surname,hrmask(CCNumber),hrmask(idNumber) from redact; Query: create view redact_m as select Title,GivenName,Surname,hrmask(CCNumber),hrmask(idNumber) from redact Fetched 0 row(s) in 0.41s [localhost.localdomain:21000] > select * from redact_m limit 2; Query: select * from redact_m limit 2 +-------+-----------+---------+------------------+---------------+ | title | givenname | surname | _c3 | _c4 | +-------+-----------+---------+------------------+---------------+ | Title | GivenName | Surname | NULL | NULL | | Ms. | Eva | Howard | 5163458320525980 | 6345832052598 | +-------+-----------+---------+------------------+---------------+ WARNINGS: Error converting column: 3 TO BIGINT (Data is: CCNumber) Error converting column: 4 TO BIGINT (Data is: idNumber) file: hdfs://localhost:8020/test/hive/fake.csv record: Title,GivenName,Surname,CCNumber,idNumber Fetched 2 row(s) in 4.74s [localhost.localdomain:21000] > results are clear as i logged as admin, but once log as other user, sensitive columns are masked. [localhost.localdomain:21000] > select * from redact_m limit 2; Query: select * from redact_m limit 2 +-------+-----------+---------+----------+----------+ | title | givenname | surname | _c3 | _c4 | +-------+-----------+---------+----------+----------+ | Title | GivenName | Surname | NULL | NULL | | Ms. | Eva | Howard | 99999999 | 99999999 | +-------+-----------+---------+----------+----------+ WARNINGS: Error converting column: 3 TO BIGINT (Data is: CCNumber) Error converting column: 4 TO BIGINT (Data is: idNumber) file: hdfs://localhost:8020/test/hive/fake.csv record: Title,GivenName,Surname,CCNumber,idNumber Fetched 2 row(s) in 0.15s [localhost.localdomain:21000] > I wish if this could be a built in function coming with sentry by default.
... View more