Reply
kfc
Explorer
Posts: 8
Registered: ‎02-06-2017
Accepted Solution

Impalad logs diskspace full

Hi,

 

im working on a poc where we store files int a HBase table using Impala.

Now we have the problem that /var/log/impalad/profiles is getting out of diskspace because every insert containing the filedata is logged there. 
I did not find anything to configure or deactivate that kind of logging.

 

cdh 5.13

 

BR

Expert Contributor
Posts: 125
Registered: ‎07-17-2017

Re: Impalad logs diskspace full

Hi @kfc

You can go to Configuration in CM Impala service and change the Impala Daemon Logging Threshold ERROR instead of INFO, so just the errors will be logged.

Highlighted
Cloudera Employee
Posts: 307
Registered: ‎10-16-2013

Re: Impalad logs diskspace full

Changing the log level will not work.

 

You can disable query profile profile logging with the following impalad startup option:

--log_query_to_file=false

 

If successful, you should see "Query profile archival is disabled" in the impalad ERROR log.

Explorer
Posts: 10
Registered: ‎03-31-2015

Re: Impalad logs diskspace full

@alex.behm Did this ever make it into CDH? The JIRA is marked as solved, but that was over 2 years ago.

 

https://community.cloudera.com/t5/Interactive-Short-cycle-SQL/How-to-cleanup-impalad-profiles-logs/t...

 

Cloudera Employee
Posts: 352
Registered: ‎07-29-2015

Re: Impalad logs diskspace full

 @mcalnd it's in CDH5.8 onwards

Announcements