Reply
New Contributor
Posts: 3
Registered: ‎10-30-2018

create hive table through Spark2 is failing in sentry enabled cluster

Create hive table from sparkSql is failing with authorization denied for create table.
Where as the same command succeeded from Beeline.

what could be the reason?

Highlighted
Posts: 518
Topics: 14
Kudos: 87
Solutions: 45
Registered: ‎09-02-2016

Re: create hive table through Spark2 is failing in sentry enabled cluster

[ Edited ]

 

@sidh

 

Not sure it is considering different user id from beeline and spark... if so

 

The one reason could be a keytab if it is a kerberoized env, you can maintain your keytab somewhere and call it from your spark-submit as follows. It will make sure to execute your spark job with required kerberos ticket

 

spark-submit .....
--master yarn \
--keytab /home/auth/myauth.keytab \

 

also pls make sure the user/group has been assigned to the required sentry role , it has been granted to the required DB with create permission 

Announcements