question Missing /user/admin directory on sandbox in Support Questions

Missing /user/admin directory on sandbox

adrian_savory — Sat, 30 Jan 2016 19:31:53 GMT

Just started using a Hortonworks sandbox on Azure, no previous experience. Started going through the 'How to process data with Apache Hive' tutorial...one of the first steps is to upload files to /user/admin. It doesn't exist. I am not able to create the admin directory under /user because the add directory option is greyed out. Instead I create a new directory under /tmp and successfully uploaded the files. However I get to loading the data into the table:

LOAD DATA INPATH '/tmp/admin/Batting.csv' OVERWRITE INTO TABLE temp_batting;

and get :

INFO : Loading data to table default.temp_batting from hdfs://sandbox.hortonworks.com:8020/tmp/admin/Batting.csv ERROR : Failed with exception Unable to move source hdfs://sandbox.hortonworks.com:8020/tmp/admin/Batting.csv to destination hdfs://sandbox.hortonworks.com:8020/apps/hive/warehouse/temp_batting/Batting.csv org.apache.hadoop.hive.ql.metadata.HiveException: Unable to move source hdfs://sandbox.hortonworks.com:8020/tmp/admin/Batting.csv to destination

Caused by: org.apache.hadoop.security.AccessControlException: Permission denied: user=hive, access=WRITE, inode="/tmp/admin/Batting.csv":admin:hdfs:drwxr-xr-x

Obviously a permissions error, but how do I change them, and how can I create /user/admin for future use?

Thanks.

Re: Missing /user/admin directory on sandbox

amcbarnett — Sat, 30 Jan 2016 19:55:49 GMT

@Adrian Savory

See the following:https://community.hortonworks.com/questions/7739/permission-denied-and-no-such-file-or-directory.html

sudo su - hdfs

hdfs dfs -mkdir /user/admin

hdfs dfs -chown root:hdfs /user/admin

Re: Missing /user/admin directory on sandbox

adrian_savory — Sat, 30 Jan 2016 20:41:09 GMT

@Ancil McBarnett Thanks for the prompt reply. Where can I run these commands from? I've only really used the Hive view so far.

Re: Missing /user/admin directory on sandbox

nsabharwal — Sat, 30 Jan 2016 20:55:49 GMT

@Adrian Savory You can use ssh or browser

http://127.0.0.1:4200

ssh -p 2222 root@127.0.0.1

Re: Missing /user/admin directory on sandbox

rmolina — Sun, 31 Jan 2016 02:29:54 GMT

Hi @Adrian Savory what tutorial are you following. I thought the tutorial mentioned to load to /tmp/admin which it states to create I believe mentioned here:

http://hortonworks.com/hadoop-tutorial/hello-world-an-introduction-to-hadoop-hcatalog-hive-and-pig/#section_4

Re: Missing /user/admin directory on sandbox

adrian_savory — Mon, 01 Feb 2016 21:48:23 GMT

@rmolina it's this one:

http://hortonworks.com/hadoop-tutorial/how-to-process-data-with-apache-hive/

Navigate to /user/admin and click on the Upload button.

Re: Missing /user/admin directory on sandbox

adrian_savory — Mon, 01 Feb 2016 22:17:11 GMT

All sorted now thanks. I could not tell how to change permissions within the Hive shell and did not know how to get to a command line to run the hdfs commands. Looking at the other tutorial I could see that you needed to right click on the files/directories to change permissions (not obvious on a mac!). So I've now been able to create /user/admin, change permissions and run the load.

Thanks again!