Created 05-24-2016 09:16 PM
Hi Folks,
Does Spark or SparkSQL supports Sentry?
Created 06-02-2016 04:36 PM
Created on 11-14-2017 08:10 AM - edited 11-14-2017 08:11 AM
we recently installed spark2 in our CDH 5.13.0 cluster. Our tests show that sentry roles are not being applied .
so are you saying that we need Sentry HMS plugin and Sentry HDFS ACL Sync enabled ? for spark programs to have Sentry roles enabled ?
Created 11-14-2017 02:53 PM
If Sentry is enabled, the HMS plugin should already be applied, so metadata write/modification queries are already authorized no matter where they come from (Hive, Impala, Spark, etc.).
The direct HDFS access to table files that Spark requires can only be granted to the end-users if you have Sentry HDFS ACL Sync enabled, such that the ACLs are applied for all granted role groups on the HDFS level automatically, allowing normal read/write access.
Created 11-16-2017 01:28 PM
Thanks @Harsh J for your response.
Does Sentry translate server level privileges to HDFS ACL's or does it just translate table privileges ?
Created on 10-30-2018 01:20 PM - edited 10-30-2018 08:32 PM
@Harsh J Create table from sparkSql is failing with authorization denied for create table.
Where as the same command succeeded from Beeline.
How can we create table through spark?