HUE parameter change from Cloudera Manager:

[#1]

Hi, HUE allows you to download the rows of a table into excel files, but by default the maximum number of rows that can be downloaded are 100,000 rows. The parameter that allows you to change the number of rows to download in excel from HUE is download_row_limit. How do you change this configuration parameter from the Cloudera manager? Best regards, Mirco

[#2 · Accepted solution]

Hi,

You can change your hue.ini in Cloudera Manager:

(take a look at beeswax section: https://github.com/cloudera/hue/blob/master/desktop/conf.dist/hue.ini)

[beeswax]

# A limit to the number of rows that can be downloaded from a query before it is truncated.
# A value of -1 means there will be no limit.
## download_row_limit=100000

Just navigate to your Hue service -> Configuration -> search for "hue_safety_valve.ini"

As you can see the rest is pretty easy.

PS: I was always wondering where this 100K is coming from, so thanks for pointing it out 🙂

Cheers!

[#3]

Thanks so much for your help, I've been able to solve the issue.

[#4]

Setting a limit to -1 is not recommended as it could have a severe performance impact. It is better to set it to the value that may resolve your issue. Or it is suggested to change the value to default again once you are done with your job. 

It will make Hue Server slow or process exited with out of memory issues, and the root cause is mostly downloading large files.

The following options currently exist for downloading files through the Impala and Hive editors:

• Use XLS if result set is <= 30K rows
• Use CSV if result set is > 30K rows
• Use Hue Safety Valve for CSV if result set > 1M rows (default). While this limitation can be bypassed, doing so may have a negative impact on performance.
  From Cloudera Manager, navigate toHue > Configuration > Service-Wide > Advanced > Hue Server Advanced Configuration Snippet (Safety Value) for hue_safety_valve_server.ini

Regards,

Tarun Jangid