Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

When uploading file in HDFS through HUE, it creates a temporary file of same size in /tmp. How to remove this file

Solved Go to solution

When uploading file in HDFS through HUE, it creates a temporary file of same size in /tmp. How to remove this file

Rising Star

I am trying to upload files from HUE to HDFS using File Browser. Everytime I upload a large file, in GBs, a temporary but same size file creates in /tmp (eg tmpxxx.upload) which is occupying whole / space and its getting filled up to 100%. My question is how to move these temporary file from /tmp to some other location having sufficient space.

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted

Re: When uploading file in HDFS through HUE, it creates a temporary file of same size in /tmp. How to remove this file

This sounds like the issue mentioned here https://github.com/cloudera/hue/issues/304, however I dont know a valid workaround for our Hue version at the moment. I strongly encourage you to use different ways to ingest large amounts of data into your cluster, e.g. separate data ingestion node (+hdfs cmds to move files into hdfs), Nifi, distcp,...

4 REPLIES 4
Highlighted

Re: When uploading file in HDFS through HUE, it creates a temporary file of same size in /tmp. How to remove this file

This sounds like the issue mentioned here https://github.com/cloudera/hue/issues/304, however I dont know a valid workaround for our Hue version at the moment. I strongly encourage you to use different ways to ingest large amounts of data into your cluster, e.g. separate data ingestion node (+hdfs cmds to move files into hdfs), Nifi, distcp,...

Re: When uploading file in HDFS through HUE, it creates a temporary file of same size in /tmp. How to remove this file

Rising Star

Thanks for the link. This issue is being faced by one of our teams and they have only access to Hue and not the command line. They are uploading archived zip files to HDFS and the size ranges from 2GB to 900GB. I already told them that Hue is not meant to upload such big files in HDFS and I am not able to find the background functionality of fileuploader anywhere online.

Re: When uploading file in HDFS through HUE, it creates a temporary file of same size in /tmp. How to remove this file

@Anshul Sisodia you may want to begin transitioning from Hue to Ambari Views. There is a File Browser view you can use to upload files.

Re: When uploading file in HDFS through HUE, it creates a temporary file of same size in /tmp. How to remove this file

@Anshul Sisodia Stick with File view. It uses webhdfs protocol.

Don't have an account?
Coming from Hortonworks? Activate your account here