Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Cloudera Hive doesn't delete old base & delta after compaction

avatar
Explorer

When I run major compaction on hive, it creates new base. But doesn't delete old base & delta

1 REPLY 1

avatar
Master Collaborator

Hello,

 

Hive compaction runs first, then a cleaner thread waits for all readers to finish reading the old base/delta files. When it determines that nobody is reading the old files anymore, only then does the deletion of the old files occur. Please run SHOW COMPACTIONS and look at the state of the compaction in question.

 

Also would help to know which version are you on for CDH/HDP/CDP? If CDP, public or private cloud?

 

Hope this helps,

Alex