Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Pyspark, create table in Hive metastore, which permissions?

Solved Go to solution

Pyspark, create table in Hive metastore, which permissions?

Which permissions do I need to set to store a table in the Hive metastore from pyspark?

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted

Re: Pyspark, create table in Hive metastore, which permissions?

@wiljan van ravensteijn

If you are running Hive with doAs=false, metastore service must have write permission in /app/hive/warehouse and also in new directories/tables you create. If you are using Sandbox 2.3.2, easiest way is to define a Ranger police to grant access to hive user, another solution would be to execute pyspark using hive user.

View solution in original post

1 REPLY 1
Highlighted

Re: Pyspark, create table in Hive metastore, which permissions?

@wiljan van ravensteijn

If you are running Hive with doAs=false, metastore service must have write permission in /app/hive/warehouse and also in new directories/tables you create. If you are using Sandbox 2.3.2, easiest way is to define a Ranger police to grant access to hive user, another solution would be to execute pyspark using hive user.

View solution in original post

Don't have an account?
Coming from Hortonworks? Activate your account here