Created 03-09-2016 08:24 AM
Hi Team,
I am trying to upload a file that more that 64MB(approximately 1GB) via the File Browser in HUE. The file uploaded and subsequently gets truncated to 64MB. But from command line it sucessfully uploaded. Is there any configuration to change in HUE?
Any ideas of what is happening and what I have to do to resolve this?
Created on 03-09-2016 03:08 PM - edited 08-19-2019 03:42 AM
Looks like others have reported the same problem before. See http://grokbase.com/t/cloudera/hue-user/137axc7mpm/upload-file-over-64mb-via-hue and https://issues.cloudera.org/browse/HUE-2782.
I do agree with HUE-2782's "we need to intentionally limit upload file size" as this is a web app and probably isn't the right tool when we are getting to some file size. Glad to hear "hdfs dfs -put" is working fine.
On the flipside, I did test this out a bit with the HDFS Files "Ambari View" that is available with the 2.4 Sandbox and as you can see from the screenshot, user maria_dev was able to load a 80MB file to her home directory via the web interface as well as a 500+MB file. I'm sure this Ambari View also has some upper limit.
Maybe it is time to start thinking about moving from Hue to Ambari Views??
Created on 03-09-2016 03:08 PM - edited 08-19-2019 03:42 AM
Looks like others have reported the same problem before. See http://grokbase.com/t/cloudera/hue-user/137axc7mpm/upload-file-over-64mb-via-hue and https://issues.cloudera.org/browse/HUE-2782.
I do agree with HUE-2782's "we need to intentionally limit upload file size" as this is a web app and probably isn't the right tool when we are getting to some file size. Glad to hear "hdfs dfs -put" is working fine.
On the flipside, I did test this out a bit with the HDFS Files "Ambari View" that is available with the 2.4 Sandbox and as you can see from the screenshot, user maria_dev was able to load a 80MB file to her home directory via the web interface as well as a 500+MB file. I'm sure this Ambari View also has some upper limit.
Maybe it is time to start thinking about moving from Hue to Ambari Views??