Create hive table from sparkSql is failing with authorization denied for create table.
Where as the same command succeeded from Beeline.
what could be the reason?
Not sure it is considering different user id from beeline and spark... if so
The one reason could be a keytab if it is a kerberoized env, you can maintain your keytab somewhere and call it from your spark-submit as follows. It will make sure to execute your spark job with required kerberos ticket
--master yarn \
--keytab /home/auth/myauth.keytab \
also pls make sure the user/group has been assigned to the required sentry role , it has been granted to the required DB with create permission