Downloading huge results from Hue

[#1]

Hi,

If I run query in Hue that returns huge amount of rows, is it possible to download them through UI? I tried it using Hive query and .csv, download was succesful, but it turned out the file had exactly 100000001 rows, while actual result should be bigger.  Is 100 milion some kind of limit - if so could it be lifted?

I was also thinking about storing results in HDFS and downloading them through file browser, but the problem is that when you click "save in HDFS", the whole query runs again from scratch, so effectively you need to run it twice to be able to do it (and i haven't checked if result would be stored as one file and if Hue could download it).

In short, is such a use case possible in Hue?

[#2]

Thanks for the info 🙂

[#3]

Can you please let us know how to do for excel/csv file for the table Select * from test

beeline -u jdbc:hive2://bla:10000 -n user -p password -f yourscript.q > yourresults.txt

[#4]

I think that the best approach to solve this issue in Hue is:

- create an external table which stores the data in TEXT format
- Load/Insert the data that you want to download there
- Go to File Browser, and browser to the location where that external table

- Download the files inside that folder

Best, Leandro

[#5]

Example please for this

 create an external table which stores the data in TEXT format
- Load/Insert the data that you want to download there
- Go to File Browser, and browser to the location where that external table

- Download the files inside that folder