Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Downloading huge results from Hue

avatar
Explorer

Hi,

 

If I run query in Hue that returns huge amount of rows, is it possible to download them through UI? I tried it using Hive query and .csv, download was succesful, but it turned out the file had exactly 100000001 rows, while actual result should be bigger.  Is 100 milion some kind of limit - if so could it be lifted?

 

I was also thinking about storing results in HDFS and downloading them through file browser, but the problem is that when you click "save in HDFS", the whole query runs again from scratch, so effectively you need to run it twice to be able to do it (and i haven't checked if result would be stored as one file and if Hue could download it).

 

In short, is such a use case possible in Hue?

 

1 ACCEPTED SOLUTION

avatar
Super Guru
Please read the above JIRA for more details. Hue is only one lightweight
Python server. Google, Dropbox etc... have tens of servers dedicated to
serving files and not Web pages (the download happens from another machine).

In Hue 4 we will very probably introduce some new types of Hue servers that
will take care of this part.

Romain

View solution in original post

13 REPLIES 13

avatar
Super Guru
Thanks for the info 🙂

avatar
New Contributor

Can you please let us know how to do for excel/csv file for the table Select * from test

 

beeline -u jdbc:hive2://bla:10000 -n user -p password -f yourscript.q > yourresults.txt

avatar
New Contributor

I think that the best approach to solve this issue in Hue is:

- create an external table which stores the data in TEXT format
- Load/Insert the data that you want to download there
- Go to File Browser, and browser to the location where that external table

- Download the files inside that folder

Best, Leandro

avatar
New Contributor

Example please for this

 create an external table which stores the data in TEXT format
- Load/Insert the data that you want to download there
- Go to File Browser, and browser to the location where that external table

- Download the files inside that folder