Support Questions
Find answers, ask questions, and share your expertise
Announcements
Check out our newest addition to the community, the Cloudera Innovation Accelerator group hub.

Impalad logs diskspace full

Explorer

Hi,

 

im working on a poc where we store files int a HBase table using Impala.

Now we have the problem that /var/log/impalad/profiles is getting out of diskspace because every insert containing the filedata is logged there. 
I did not find anything to configure or deactivate that kind of logging.

 

cdh 5.13

 

BR

1 ACCEPTED SOLUTION

Master Collaborator

Changing the log level will not work.

 

You can disable query profile profile logging with the following impalad startup option:

--log_query_to_file=false

 

If successful, you should see "Query profile archival is disabled" in the impalad ERROR log.

View solution in original post

4 REPLIES 4

Expert Contributor

Hi @kfc

You can go to Configuration in CM Impala service and change the Impala Daemon Logging Threshold ERROR instead of INFO, so just the errors will be logged.

Master Collaborator

Changing the log level will not work.

 

You can disable query profile profile logging with the following impalad startup option:

--log_query_to_file=false

 

If successful, you should see "Query profile archival is disabled" in the impalad ERROR log.

Explorer

@alex.behm Did this ever make it into CDH? The JIRA is marked as solved, but that was over 2 years ago.

 

https://community.cloudera.com/t5/Interactive-Short-cycle-SQL/How-to-cleanup-impalad-profiles-logs/t...

 

 @mcalnd it's in CDH5.8 onwards