question Re: location of user and other data in Ambari HDP installation in Archives of Support Questions (Read Only)

location of user and other data in Ambari HDP installation

prakashpunj — Fri, 12 Feb 2016 09:45:18 GMT

Wondering where are information stored in Ambari. For example:

user data : i created user in Ambari and added an account on the machine with the same name. Where can I see the files uploaded by this user

location of all the services: ??

Location of HDP files ?

basically need to know the file structure of Ambari HDP installation.

Thanks

Re: location of user and other data in Ambari HDP installation

divakarreddy_a — Fri, 12 Feb 2016 10:07:11 GMT

@Prakash Punj

User information in Ambari DB

and files information in HDFS with owner as your created user.

Re: location of user and other data in Ambari HDP installation

nsabharwal — Fri, 12 Feb 2016 10:16:04 GMT

@Prakash Punj

Following 2 commands will give you lot of information regarding binaries

ls -l /usr/hdp/current

ls -l /usr/hdp

ls -l /etc --> you can see configs of each component

user data : i created user in Ambari and added an account on the machine with the same name. Where can I see the files uploaded by this user

su - hdfs

hdfs dfs -mkdir /user/username

hdfs dfs -chown -R username:hdfs /user/username

exit

hdfs dfs -ls

pick any file , for example /tmp/notes.txt --> local file system

now, login with your user

su - username

hdfs dfs -ls

hdfs dfs -put /tmp/notes.txt

hdfs dfs -ls

You should see notes.txt on hdfs

You can do the same using Filesystem view , its in ambari

Ambari will give you information on HDP components.

Re: location of user and other data in Ambari HDP installation

nsabharwal — Fri, 12 Feb 2016 10:19:08 GMT

@Prakash Punj Ambari DB contains useful information related to the cluster. See this http://hortonworks.com/hadoop/ambari/

Re: location of user and other data in Ambari HDP installation

prakashpunj — Sat, 13 Feb 2016 04:01:01 GMT

@Neeraj Sabharwal

Thanks Neeraj. So in order to see the files you have to logon using that user and then you can list via hdfs interface.

Now I need to add more space to the directory where these files are stored. We have added a separate device to the VM and I need to link to existing data directory to this new device so that users can upload more data.

So I think if I assign the disk to /usr/hdp, it will be fine.

Thanks

Re: location of user and other data in Ambari HDP installation

nsabharwal — Sat, 13 Feb 2016 06:40:00 GMT

@Prakash Punj Login as root in the box

This is what I suggest to customer

/ - whatever company policy

each node

/usr/hd - Binaries ~ 30 to 50GB

/var/log - logs ~200GB

/hadoop or whatever mount point - Size based on customer use case

In your case , you can increase the volume size on the fly as it's vm or whatever works best for you. I am not big fan of symlinks.

Re: location of user and other data in Ambari HDP installation

nsabharwal — Sat, 20 Feb 2016 10:22:13 GMT

@Prakash Punj Help me to close this thread by accepting one of the best answers.