question Impalad logs diskspace full in Archives of Support Questions (Read Only)

Impalad logs diskspace full

kfc — Fri, 16 Sep 2022 12:55:36 GMT

Hi,

im working on a poc where we store files int a HBase table using Impala.

Now we have the problem that /var/log/impalad/profiles is getting out of diskspace because every insert containing the filedata is logged there.
I did not find anything to configure or deactivate that kind of logging.

cdh 5.13

Re: Impalad logs diskspace full

AcharkiMed — Fri, 02 Mar 2018 15:28:28 GMT

Hi @kfc

You can go to Configuration in CM Impala service and change the Impala Daemon Logging Threshold ERROR instead of INFO, so just the errors will be logged.

Re: Impalad logs diskspace full

alex.behm — Fri, 02 Mar 2018 17:13:50 GMT

Changing the log level will not work.

You can disable query profile profile logging with the following impalad startup option:

--log_query_to_file=false

If successful, you should see "Query profile archival is disabled" in the impalad ERROR log.

Re: Impalad logs diskspace full

mcalnd — Fri, 13 Jul 2018 06:57:36 GMT

@alex.behm Did this ever make it into CDH? The JIRA is marked as solved, but that was over 2 years ago.

https://community.cloudera.com/t5/Interactive-Short-cycle-SQL/How-to-cleanup-impalad-profiles-logs/td-p/36588

Re: Impalad logs diskspace full

Tim Armstrong — Fri, 13 Jul 2018 15:51:20 GMT

@mcalnd it's in CDH5.8 onwards