question Re: Permission Denied for user=hive on LOAD DATA INPATH in Archives of Support Questions (Read Only)

Permission Denied for user=hive on LOAD DATA INPATH

pelasne — Mon, 28 Dec 2015 23:33:07 GMT

When trying to go through the tutorials on http://hortonworks.com/hadoop-tutorial/hello-world... I get a permission denied error when trying to LOAD DATA INPATH '/tmp/admin/data/trucks.csv' OVERWRITE INTO TABLE trucks_stage;

This is using a brand new sandbox 2.3.2 instance in Azure. I did give the trucks.csv file WRITE permission for all 3. I am logged into Ambari as "admin". It appears the operation is running as "hive", which makes sense since that shows as the service account.

LOG SNIPPET:

INFO : Loading data to table default.trucks_stage from hdfs://sandbox.hortonworks.com:8020/tmp/admin/data/trucks.csv ERROR : Failed with exception Unable to move source hdfs://sandbox.hortonworks.com:8020/tmp/admin/data/trucks.csv to destination hdfs://sandbox.hortonworks.com:8020/apps/hive/warehouse/trucks_stage/trucks.csv org.apache.hadoop.hive.ql.metadata.HiveException: Unable to move source hdfs://sandbox.hortonworks.com:8020/tmp/admin/data/trucks.csv to destination hdfs://sandbox.hortonworks.com:8020/apps/hive/warehouse/trucks_stage/trucks.csv

...

Caused by: org.apache.hadoop.security.AccessControlException: Permission denied: user=hive, access=WRITE, inode="/tmp/admin/data/trucks.csv":admin:hdfs:drwxr-xr-x

Re: Permission Denied for user=hive on LOAD DATA INPATH

pardeep_kumar — Tue, 29 Dec 2015 02:12:52 GMT

@Peter Lasne As you see, only admin user has write access which is resulting into this issue. Please give write access to Hive user here and that should fix issue. Usually I would recommend having rwxrwxrwx on /tmp.

/tmp/admin/data/trucks.csv":admin:hdfs:drwxr-xr-x

Re: Permission Denied for user=hive on LOAD DATA INPATH

gbraccialli3 — Tue, 29 Dec 2015 02:21:09 GMT

@Peter Lasne

Please, give write access to everyone to folder /tmp/admin/data also, not only file /tmp/admin/data/trucks.csv

Re: Permission Denied for user=hive on LOAD DATA INPATH

pelasne — Tue, 29 Dec 2015 04:12:42 GMT

Thanks, granting permission for all users from /tmp up through /data worked fine. I am confused why the tutorial from http://hortonworks.com/hadoop-tutorial/hello-world... specifies only changing the permissions on the file if more than that is required.

Re: Permission Denied for user=hive on LOAD DATA INPATH

gbraccialli3 — Tue, 29 Dec 2015 04:16:43 GMT

@Peter Lasne

Tutorial will be fixed ASAP.

@zblanco

Re: Permission Denied for user=hive on LOAD DATA INPATH

zblanco — Tue, 29 Dec 2015 21:42:11 GMT

The part of the tutorial in question has been updated.

Re: Permission Denied for user=hive on LOAD DATA INPATH

Manoj690 — Mon, 09 Sep 2019 11:45:48 GMT

How to give write access to the file or folder