Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

When uploading file in HDFS through HUE, it creates a temporary file of same size in /tmp. How to remove this file

avatar
Expert Contributor

I am trying to upload files from HUE to HDFS using File Browser. Everytime I upload a large file, in GBs, a temporary but same size file creates in /tmp (eg tmpxxx.upload) which is occupying whole / space and its getting filled up to 100%. My question is how to move these temporary file from /tmp to some other location having sufficient space.

1 ACCEPTED SOLUTION

avatar

This sounds like the issue mentioned here https://github.com/cloudera/hue/issues/304, however I dont know a valid workaround for our Hue version at the moment. I strongly encourage you to use different ways to ingest large amounts of data into your cluster, e.g. separate data ingestion node (+hdfs cmds to move files into hdfs), Nifi, distcp,...

View solution in original post

4 REPLIES 4

avatar

This sounds like the issue mentioned here https://github.com/cloudera/hue/issues/304, however I dont know a valid workaround for our Hue version at the moment. I strongly encourage you to use different ways to ingest large amounts of data into your cluster, e.g. separate data ingestion node (+hdfs cmds to move files into hdfs), Nifi, distcp,...

avatar
Expert Contributor

Thanks for the link. This issue is being faced by one of our teams and they have only access to Hue and not the command line. They are uploading archived zip files to HDFS and the size ranges from 2GB to 900GB. I already told them that Hue is not meant to upload such big files in HDFS and I am not able to find the background functionality of fileuploader anywhere online.

avatar

@Anshul Sisodia you may want to begin transitioning from Hue to Ambari Views. There is a File Browser view you can use to upload files.

avatar
Master Mentor

@Anshul Sisodia Stick with File view. It uses webhdfs protocol.