question Re: HIVE: No Cleanup working after Compaction: in Support Questions

HIVE: No Cleanup working after Compaction:

sujonict07 — Tue, 01 Jun 2021 14:43:23 GMT

I have run manually minor and major compaction. Table data is referring to the new delta and base folder but the old delta and base folders are not removing and it consumes the hive storage. Moreover, No running job is referring to this table.
Queries:

create table compaction_check.check_file(name string, age int); insert into compaction_check.check_file values('user 1', 10),('user 2', 20),('user 3', 30); insert into compaction_check.check_file values('user 4', 10),('user 5', 30),('user 6', 15); ALTER TABLE compaction_check.check_file COMPACT 'major';

Check input files:

select distinct INPUT__FILE__NAME FROM compaction_check.check_file;

output:

Actual table directory :

Why stale the base and delta folders are not removed?

Re: HIVE: No Cleanup working after Compaction:

aakulov — Tue, 01 Jun 2021 17:45:31 GMT

Hello,

Could you please provide the output of

SHOW TBLPROPERTIES compaction_check.check_file;

Also, which version of CDH/HDP or CDP are you using?

Thank you,

Alex

Re: HIVE: No Cleanup working after Compaction:

sujonict07 — Wed, 02 Jun 2021 04:21:31 GMT

Hi @aakulov,

I am using Cloudera 7.1.3 and HIVE version: 3.1.3

Table TBLPROPERTIES Output:

Thanks in Advance.

Re: HIVE: No Cleanup working after Compaction:

aakulov — Wed, 02 Jun 2021 14:45:45 GMT

Hello again,

Base on the output, looks like the table itself is using the default compaction settings. That's good. Next place to check is the global Hive parameters and their values. Note that some of these settings are turned off by default (e.g. hive.compactor.initiator.on = false). See documentation below:

https://docs.cloudera.com/cdp-private-cloud-base/7.1.3/managing-hive/topics/hive-compact-properties.html

Hope this helps,

Alex

Re: HIVE: No Cleanup working after Compaction:

sujonict07 — Thu, 03 Jun 2021 09:56:59 GMT

Hello @aakulov,
In my Hive Configuration,

hive.compactor.initiator.on = Enabled

Here is the screenshot of Hive and hiveServer2 configurations:

Now, Is there anything else that I have to check or configure to remove the older base and delta folders?

Thank you again, Alex.

Re: HIVE: No Cleanup working after Compaction:

aakulov — Thu, 03 Jun 2021 13:49:51 GMT

Ok, after you execute COMPACT on your table. Can you also run:

SHOW COMPACTIONS;

To see what state the compaction operation ends up in.

Another place to look is in the HMS logs. Search for your table name and see what compaction events have and have not occurred for your table. Please provide pertinent log lines here.

Also check to see if you have this parameter in hive-site.xml:

hive.metastore.housekeeping.threads.on==true

This is responsible for timing out stale transactions on the table. If it's not on, stale transactions are never cleaned up and, as a consequence, Hive does not remove the old delta files. If you make a change to this value, you'll need to restart the stale service.

Re: HIVE: No Cleanup working after Compaction:

aakulov — Wed, 09 Jun 2021 16:17:13 GMT

Were you able to have Hive clean up the obsolete files? Just checking in.