question Re: hdfs upload fails with ugly file name in Archives of Support Questions (Read Only)

hdfs upload fails with ugly file name

michael_klybor — Sat, 30 Apr 2016 03:34:22 GMT

attempts to upload a file from ambari fails by generating an invalid target file name. it creates a target filename (hdfs) by removing all of the path delimiters from the source file name, resulting in a ridiculously long file name that additionally contains "c:". I don't see any way of controlling this. running it all on windows. all I do is browse for the local file and then upload.

exception:

500

Pathname /tmp/maria_dev/data/C:UsersXXXXXDownloadsHortonworksGeolocationgeolocation.csv from /tmp/maria_dev/data/C:UsersXXXXXDownloadsHortonworksGeolocationgeolocation.csv is not a valid DFS filename.

Collapse Stack Trace

java.lang.IllegalArgumentException: Pathname /tmp/maria_dev/data/C:UsersklyborDownloadsHortonworksGeolocationgeolocation.csv from /tmp/maria_dev/data/C:UsersklyborDownloadsHortonworksGeolocationgeolocation.csv is not a valid DFS filename

Re: hdfs upload fails with ugly file name

hduraiswamy — Sat, 30 Apr 2016 22:09:58 GMT

try scp

scp -P 2222 Downloads/HortonworksGeolocationgeolocation.csv root@<hadoop node>:/tmp/maria_dev/data/

Re: hdfs upload fails with ugly file name

hduraiswamy — Sat, 30 Apr 2016 22:10:53 GMT

if it is sandbox, the above command will look like:

scp -P 2222 Downloads/HortonworksGeolocationgeolocation.csv root@127.0.0.1:/tmp/maria_dev/data/

Re: hdfs upload fails with ugly file name

michael_klybor — Sun, 01 May 2016 06:19:12 GMT

thanks @hduraiswamy

used filezilla to do the uploads. would be nice it this ambari feature worked because it is really convenient.

Re: hdfs upload fails with ugly file name

michael_klybor — Sun, 01 May 2016 06:48:05 GMT

@hduraiswamy

I know the problem. It is an IE 11 feature that I encountered and dealt with for one of my own apps.

I can do the upload with Chrome. IE 11 passes the full local file pathname at times (depends upon user browser options) . Ambari needs to strip off the path prefix when forming the server filename.

Re: hdfs upload fails with ugly file name

hduraiswamy — Sun, 01 May 2016 09:25:27 GMT

@michael klybor - good point.. It actually makes sense to post that to the Ambari forum as a suggestion..

Re: hdfs upload fails with ugly file name

Richard_Wheeler — Wed, 30 Jan 2019 10:22:26 GMT

have the same issue using Edge browser