Member since
11-18-2020
3
Posts
0
Kudos Received
0
Solutions
05-20-2023
11:37 PM
@mwblee I am not sure if you are using any Cloudera Hive distribution, if you are, consider upgrading to latest CDP version where we have fixed many issues around compactor initiator/worker/cleaner. e.g. For initiator: upstream Jiras - HIVE-21917, HIVE-22568, HIVE-22081 For this specific issue, you may check take a look at multiple factors, such as Hive metastore being overloaded, slow/large(certain txn related tables) metastore database. You may enable DEBUG logging in Hive metastore, and this will provide more information on why/where the compactor is stuck. If you are using opensource Hive, upgrade to Hive 4.x; you will have much better experience w.r.t. compaction.
... View more