question Re: Cannot find files copied to Sandbox from Windows in Support Questions

Cannot find files copied to Sandbox from Windows

praskutti — Sun, 18 Aug 2019 12:39:57 GMT

Hello.. I used PuTTy's pscp command to copy a file (Windows 10) to my Sandbox (HDP 2.5, hosted on VMWare Workstation 12). The copy looked sucessfull

But i cannot find the file anywhere in the system - i used the command line (PuTTy) as well as Ambari Web interfac; couldnt find it at all.

Praskutti is a folder i created in /user/ and in the /root , but cant find the file in neither.

Can you guys help me where//how to find the files?

Re: Cannot find files copied to Sandbox from Windows

mqureshi — Tue, 31 Jan 2017 10:15:39 GMT

@Prasanna G

I think you are copying in your local file system and looking in your HDFS. Check your local tmp folder. Also, your full command is invisible but I am assuming its something like below:

pscp -P 2222 C:\Users\prgovind\Downloads\f.txt root@localhost:///tmp

Is that right? I think you first need to copy to local tmp folder on your sand box and then push it into HDFS. Try following:

pscp -P 2222 C:\Users\prgovind\Downloads\f.txt root@sandbox:/tmp

ssh root@sandbox

hdfs dfs -put /tmp/f.txt /user/praskutti

Re: Cannot find files copied to Sandbox from Windows

praskutti — Tue, 31 Jan 2017 10:42:29 GMT

Thank you qureshi. This solved my issue.

Is there any documentation on the HortonWorks Sandbox File Sytem? I understand hadoop/hdfs file system are differenct from your response, but is there a clearer documentation on how to navigate around the file system within the Sandbox?

Re: Cannot find files copied to Sandbox from Windows

praskutti — Tue, 31 Jan 2017 10:45:56 GMT

In essence, how do i query/distinguish local Sandbox file system and hdfs file system? I put the following queries in PuTTy, but it doesnt return anything

hadoop fs -ls /tmp <--doenst show the file

hdfs dfs -ls /tmp <-- shows the file

Am i missing something?

Re: Cannot find files copied to Sandbox from Windows

mqureshi — Tue, 31 Jan 2017 11:00:04 GMT

@Prasanna G

All documentation for sandbox is right here which I think you are aware of. As for which file system, I have never verified but I would think it is standard linux file system like ext4. Just type "mount" command without any parameters and it will show you the mounted file systems and their types.

http://hortonworks.com/hadoop-tutorial/learning-the-ropes-of-the-hortonworks-sandbox/

Re: Cannot find files copied to Sandbox from Windows

Former Member — Tue, 31 Jan 2017 23:19:27 GMT

I would suggest check out this tutorial series on HDFS:

http://hortonworks.com/hadoop-tutorial/using-commandline-manage-files-hdfs/

Re: Cannot find files copied to Sandbox from Windows

mqureshi — Wed, 01 Feb 2017 00:55:32 GMT

@Prasanna G

your putty is an ssh client and not an hdfs client. once you ssh to your sandbox, then you are able to run hdfs command because sandbox is where HDFS is installed including on your shell commands. This is simialr to the fact that you cannot run "ls /some directory" from putty before you ssh into the box.