Impalad logs diskspace full

[#1]

Hi,

im working on a poc where we store files int a HBase table using Impala.

Now we have the problem that /var/log/impalad/profiles is getting out of diskspace because every insert containing the filedata is logged there. 
I did not find anything to configure or deactivate that kind of logging.

cdh 5.13

BR

[#2]

Hi @kfc

You can go to Configuration in CM Impala service and change the Impala Daemon Logging Threshold ERROR instead of INFO, so just the errors will be logged.

[#3 · Accepted solution]

Changing the log level will not work.

You can disable query profile profile logging with the following impalad startup option:

--log_query_to_file=false

If successful, you should see "Query profile archival is disabled" in the impalad ERROR log.

[#4]

@alex.behm Did this ever make it into CDH? The JIRA is marked as solved, but that was over 2 years ago.

https://community.cloudera.com/t5/Interactive-Short-cycle-SQL/How-to-cleanup-impalad-profiles-logs/t...

[#5]

 @mcalnd it's in CDH5.8 onwards