Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Pyspark, create table in Hive metastore, which permissions?

avatar

Which permissions do I need to set to store a table in the Hive metastore from pyspark?

1 ACCEPTED SOLUTION

avatar

@wiljan van ravensteijn

If you are running Hive with doAs=false, metastore service must have write permission in /app/hive/warehouse and also in new directories/tables you create. If you are using Sandbox 2.3.2, easiest way is to define a Ranger police to grant access to hive user, another solution would be to execute pyspark using hive user.

View solution in original post

1 REPLY 1

avatar

@wiljan van ravensteijn

If you are running Hive with doAs=false, metastore service must have write permission in /app/hive/warehouse and also in new directories/tables you create. If you are using Sandbox 2.3.2, easiest way is to define a Ranger police to grant access to hive user, another solution would be to execute pyspark using hive user.