Support Questions
Find answers, ask questions, and share your expertise

create hive table through Spark2 is failing in sentry enabled cluster

New Contributor

Create hive table from sparkSql is failing with authorization denied for create table.
Where as the same command succeeded from Beeline.

what could be the reason?






Not sure it is considering different user id from beeline and spark... if so


The one reason could be a keytab if it is a kerberoized env, you can maintain your keytab somewhere and call it from your spark-submit as follows. It will make sure to execute your spark job with required kerberos ticket


spark-submit .....
--master yarn \
--keytab /home/auth/myauth.keytab \


also pls make sure the user/group has been assigned to the required sentry role , it has been granted to the required DB with create permission 

Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.