Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here. Want to know more about what has changed? Check out the Community News blog.

create hive table through Spark2 is failing in sentry enabled cluster

create hive table through Spark2 is failing in sentry enabled cluster

New Contributor

Create hive table from sparkSql is failing with authorization denied for create table.
Where as the same command succeeded from Beeline.

what could be the reason?

1 REPLY 1

Re: create hive table through Spark2 is failing in sentry enabled cluster

Champion

 

@sidh

 

Not sure it is considering different user id from beeline and spark... if so

 

The one reason could be a keytab if it is a kerberoized env, you can maintain your keytab somewhere and call it from your spark-submit as follows. It will make sure to execute your spark job with required kerberos ticket

 

spark-submit .....
--master yarn \
--keytab /home/auth/myauth.keytab \

 

also pls make sure the user/group has been assigned to the required sentry role , it has been granted to the required DB with create permission