Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Impalad logs diskspace full

Solved Go to solution
Highlighted

Impalad logs diskspace full

Explorer

Hi,

 

im working on a poc where we store files int a HBase table using Impala.

Now we have the problem that /var/log/impalad/profiles is getting out of diskspace because every insert containing the filedata is logged there. 
I did not find anything to configure or deactivate that kind of logging.

 

cdh 5.13

 

BR

1 ACCEPTED SOLUTION

Accepted Solutions

Re: Impalad logs diskspace full

Master Collaborator

Changing the log level will not work.

 

You can disable query profile profile logging with the following impalad startup option:

--log_query_to_file=false

 

If successful, you should see "Query profile archival is disabled" in the impalad ERROR log.

4 REPLIES 4

Re: Impalad logs diskspace full

Expert Contributor

Hi @kfc

You can go to Configuration in CM Impala service and change the Impala Daemon Logging Threshold ERROR instead of INFO, so just the errors will be logged.

Re: Impalad logs diskspace full

Master Collaborator

Changing the log level will not work.

 

You can disable query profile profile logging with the following impalad startup option:

--log_query_to_file=false

 

If successful, you should see "Query profile archival is disabled" in the impalad ERROR log.

Re: Impalad logs diskspace full

Explorer

@alex.behm Did this ever make it into CDH? The JIRA is marked as solved, but that was over 2 years ago.

 

https://community.cloudera.com/t5/Interactive-Short-cycle-SQL/How-to-cleanup-impalad-profiles-logs/t...

 

Re: Impalad logs diskspace full

Master Collaborator

 @mcalnd it's in CDH5.8 onwards

Don't have an account?
Coming from Hortonworks? Activate your account here