10-30-2018 01:59 PM
Create hive table from sparkSql is failing with authorization denied for create table.
Where as the same command succeeded from Beeline.
what could be the reason?
11-02-2018 09:14 AM - edited 11-02-2018 09:20 AM
Not sure it is considering different user id from beeline and spark... if so
The one reason could be a keytab if it is a kerberoized env, you can maintain your keytab somewhere and call it from your spark-submit as follows. It will make sure to execute your spark job with required kerberos ticket
--master yarn \
--keytab /home/auth/myauth.keytab \
also pls make sure the user/group has been assigned to the required sentry role , it has been granted to the required DB with create permission