03-02-2018 07:01 AM
im working on a poc where we store files int a HBase table using Impala.
Now we have the problem that /var/log/impalad/profiles is getting out of diskspace because every insert containing the filedata is logged there.
I did not find anything to configure or deactivate that kind of logging.
03-02-2018 09:13 AM
Changing the log level will not work.
You can disable query profile profile logging with the following impalad startup option:
If successful, you should see "Query profile archival is disabled" in the impalad ERROR log.