Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

HUE parameter change from Cloudera Manager:

avatar
New Contributor
Hi, HUE allows you to download the rows of a table into excel files, but by default the maximum number of rows that can be downloaded are 100,000 rows. The parameter that allows you to change the number of rows to download in excel from HUE is download_row_limit. How do you change this configuration parameter from the Cloudera manager? Best regards, Mirco
1 ACCEPTED SOLUTION

avatar
Expert Contributor

Hi,

 

You can change your hue.ini in Cloudera Manager:

 

(take a look at beeswax section: https://github.com/cloudera/hue/blob/master/desktop/conf.dist/hue.ini)

 

[beeswax]

# A limit to the number of rows that can be downloaded from a query before it is truncated.
# A value of -1 means there will be no limit.
## download_row_limit=100000

 

Just navigate to your Hue service -> Configuration -> search for "hue_safety_valve.ini"

 

As you can see the rest is pretty easy.

Screenshot 2017-09-11 20.44.11.png

 

 

 

PS: I was always wondering where this 100K is coming from, so thanks for pointing it out 🙂

 

Cheers!

 

View solution in original post

3 REPLIES 3

avatar
Expert Contributor

Hi,

 

You can change your hue.ini in Cloudera Manager:

 

(take a look at beeswax section: https://github.com/cloudera/hue/blob/master/desktop/conf.dist/hue.ini)

 

[beeswax]

# A limit to the number of rows that can be downloaded from a query before it is truncated.
# A value of -1 means there will be no limit.
## download_row_limit=100000

 

Just navigate to your Hue service -> Configuration -> search for "hue_safety_valve.ini"

 

As you can see the rest is pretty easy.

Screenshot 2017-09-11 20.44.11.png

 

 

 

PS: I was always wondering where this 100K is coming from, so thanks for pointing it out 🙂

 

Cheers!

 

avatar
New Contributor

Thanks so much for your help, I've been able to solve the issue.


download_row_limit.PNG

avatar
Expert Contributor

Setting a limit to -1 is not recommended as it could have a severe performance impact. It is better to set it to the value that may resolve your issue. Or it is suggested to change the value to default again once you are done with your job. 

 

It will make Hue Server slow or process exited with out of memory issues, and the root cause is mostly downloading large files.

 

The following options currently exist for downloading files through the Impala and Hive editors:

  • Use XLS if result set is <= 30K rows
  • Use CSV if result set is > 30K rows
  • Use Hue Safety Valve for CSV if result set > 1M rows (default). While this limitation can be bypassed, doing so may have a negative impact on performance.
    From Cloudera Manager, navigate toHue > Configuration > Service-Wide > Advanced > Hue Server Advanced Configuration Snippet (Safety Value) for hue_safety_valve_server.ini

 

Regards,

Tarun Jangid