06-02-2016 04:36 PM
11-14-2017 08:10 AM - edited 11-14-2017 08:11 AM
we recently installed spark2 in our CDH 5.13.0 cluster. Our tests show that sentry roles are not being applied .
so are you saying that we need Sentry HMS plugin and Sentry HDFS ACL Sync enabled ? for spark programs to have Sentry roles enabled ?
11-14-2017 02:53 PM
If Sentry is enabled, the HMS plugin should already be applied, so metadata write/modification queries are already authorized no matter where they come from (Hive, Impala, Spark, etc.).
The direct HDFS access to table files that Spark requires can only be granted to the end-users if you have Sentry HDFS ACL Sync enabled, such that the ACLs are applied for all granted role groups on the HDFS level automatically, allowing normal read/write access.
10-30-2018 01:20 PM - edited 10-30-2018 08:32 PM
@Harsh J Create table from sparkSql is failing with authorization denied for create table.
Where as the same command succeeded from Beeline.
How can we create table through spark?