Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Impalad logs diskspace full

avatar
Explorer

Hi,

 

im working on a poc where we store files int a HBase table using Impala.

Now we have the problem that /var/log/impalad/profiles is getting out of diskspace because every insert containing the filedata is logged there. 
I did not find anything to configure or deactivate that kind of logging.

 

cdh 5.13

 

BR

1 ACCEPTED SOLUTION

avatar

Changing the log level will not work.

 

You can disable query profile profile logging with the following impalad startup option:

--log_query_to_file=false

 

If successful, you should see "Query profile archival is disabled" in the impalad ERROR log.

View solution in original post

4 REPLIES 4

avatar
Master Collaborator

Hi @kfc

You can go to Configuration in CM Impala service and change the Impala Daemon Logging Threshold ERROR instead of INFO, so just the errors will be logged.

avatar

Changing the log level will not work.

 

You can disable query profile profile logging with the following impalad startup option:

--log_query_to_file=false

 

If successful, you should see "Query profile archival is disabled" in the impalad ERROR log.

avatar
Explorer

@alex.behm Did this ever make it into CDH? The JIRA is marked as solved, but that was over 2 years ago.

 

https://community.cloudera.com/t5/Interactive-Short-cycle-SQL/How-to-cleanup-impalad-profiles-logs/t...

 

avatar

 @mcalnd it's in CDH5.8 onwards