location of user and other data in Ambari HDP installation

[#1]

Wondering where are information stored in Ambari. For example:

user data : i created user in Ambari and added an account on the machine with the same name. Where can I see the files uploaded by this user

location of all the services: ??

Location of HDP files ?

basically need to know the file structure of Ambari HDP installation.

Thanks

[#2]

@Prakash Punj

User information in Ambari DB

and files information in HDFS with owner as your created user.

[#3 · Accepted solution]

@Prakash Punj

Following 2 commands will give you lot of information regarding binaries

ls -l /usr/hdp/current

ls -l /usr/hdp

ls -l /etc --> you can see configs of each component

user data : i created user in Ambari and added an account on the machine with the same name. Where can I see the files uploaded by this user

login to server as root

su - hdfs

hdfs dfs -mkdir /user/username

hdfs dfs -chown -R username:hdfs /user/username

exit

hdfs dfs -ls

pick any file , for example /tmp/notes.txt --> local file system

now, login with your user

su - username

hdfs dfs -ls

hdfs dfs -put /tmp/notes.txt

hdfs dfs -ls

You should see notes.txt on hdfs

You can do the same using Filesystem view , its in ambari

Ambari will give you information on HDP components.

[#4]

@Prakash Punj Ambari DB contains useful information related to the cluster. See this http://hortonworks.com/hadoop/ambari/

[#5]

@Neeraj Sabharwal

Thanks Neeraj. So in order to see the files you have to logon using that user and then you can list via hdfs interface.

Now I need to add more space to the directory where these files are stored. We have added a separate device to the VM and I need to link to existing data directory to this new device so that users can upload more data.

So I think if I assign the disk to /usr/hdp, it will be fine.

Thanks

[#6]

@Prakash Punj Login as root in the box

This is what I suggest to customer

/ - whatever company policy

each node

/usr/hd - Binaries ~ 30 to 50GB

/var/log - logs ~200GB

/hadoop or whatever mount point - Size based on customer use case

In your case , you can increase the volume size on the fly as it's vm or whatever works best for you. I am not big fan of symlinks.

[#7]

@Prakash Punj Help me to close this thread by accepting one of the best answers.