question Re: Why can't I upload a simple text file onto HDFS ? in Support Questions

Why can't I upload a simple text file onto HDFS ?

kelvintong718 — Thu, 13 Apr 2017 15:10:42 GMT

I've been trying to upload a basic txt file onto HDFS but it won't upload. I have tried multiple files of different sizes and extensions and found the reason to be the size of my text file (approx 150 bytes). All files over around 10kb seems to work fine... Does anyone have a solution to this ? Thanks

Kelvin

Re: Why can't I upload a simple text file onto HDFS ?

avijeetd — Thu, 13 Apr 2017 15:14:31 GMT

What error it throws? Thanks.

Re: Why can't I upload a simple text file onto HDFS ?

kelvintong718 — Thu, 13 Apr 2017 15:24:15 GMT

there isn't a specific error. Usually when I drag and drop a file onto the cloud icon, it quickly uploads. But when i drag and drop my txt files there is no response. I have seen other people successfully upload files of less than 1kb on youtube so I know it is possible. I just don't know why mine isn't working

Re: Why can't I upload a simple text file onto HDFS ?

kelvintong718 — Thu, 13 Apr 2017 15:25:15 GMT

@Avijeet Dash

Re: Why can't I upload a simple text file onto HDFS ?

ramcharantej — Thu, 13 Apr 2017 15:48:16 GMT

Can you try manually uploading the file from CLI using the below command?

hdfs dfs -copyFromLocal <localsrc> URI

hdfs dfs -put <localsrc> ... <dst>

Eg: hdfs dfs -put localfile /user/hadoop/hadoopfile

Re: Why can't I upload a simple text file onto HDFS ?

kelvintong718 — Sun, 18 Aug 2019 06:10:07 GMT

@Ram Charan Tej

I've tried that but i keep getting the error as shown below:

Am i just typing my file path wrong ? As you can see I'm trying to upload 'booth1.txt'

Thanks for your help !

Re: Why can't I upload a simple text file onto HDFS ?

ramcharantej — Thu, 13 Apr 2017 18:19:54 GMT

Can you remove the backslash before the "\"C:\users 1. 'L' is caps for 'Local' not small letter, so it is hdfs dfs -copyFromLocal <source> hdfs://<URI> 2. you have to remove backslash before "C" drive and try !

Re: Why can't I upload a simple text file onto HDFS ?

kelvintong718 — Sun, 18 Aug 2019 06:09:59 GMT

Hello, I've tried it but it still doesn't work for me. Sorry I'm pretty new to this so if possible could you type out exactly what

I should be typing ?? Thanks heaps ! The error I'm getting is shown below:

Re: Why can't I upload a simple text file onto HDFS ?

balavignesh_nag — Thu, 13 Apr 2017 20:07:12 GMT

@Kelvin Tong

Are you trying to copy the file from windows to hadoop? I think the file which you are trying to be copied should be present in the server on which hadoop is installed..

Re: Why can't I upload a simple text file onto HDFS ?

kelvintong718 — Thu, 13 Apr 2017 20:19:06 GMT

@Bala Vignesh N V

Yes, the file is currently on windows. How do i put it on the server ? My host is 127.0.0.1

Re: Why can't I upload a simple text file onto HDFS ?

myoung — Thu, 13 Apr 2017 20:19:30 GMT

@Kelvin Tong

Based on the screen shots you are providing, you are attempting to push the file to HDFS using the command line within the Sandbox itself. However, you are specifying a file path that is local to the computer running the VIrtualBox Sandbox VM. That won't work. The Sandbox has no way of knowing how to access "C:\".

You must first push the file to the Sandbox using WinSCP. Then you can use the hdfs dsfs -put command using a local directory within the Sandbox (something like /root/<my filename>).

Re: Why can't I upload a simple text file onto HDFS ?

balavignesh_nag — Thu, 13 Apr 2017 20:57:55 GMT

@Kelvin Tong

Copy your file from windows to the host 127.0.0.1. From local directory copy to HDFS using

hadoop fs -ls <local file path> <hdfs path>

Re: Why can't I upload a simple text file onto HDFS ?

kelvintong718 — Thu, 13 Apr 2017 22:05:13 GMT

@Michael Young

Thanks ! That worked like a charm. I still have no idea why it doesn't let me upload using the HDFS UI so if you know why then I would love to know.