Community Articles
Find and share helpful community-sourced technical articles.
Labels (1)
Rising Star

Issue

Partition discovery such as "metastore.partition.management.task.frequency" and "partition.retention.period" does not take effect in Hive if metastore.compactor.initiator.on is not turned on by default on HMS. The same property is responsible for activating Hive Metastore background tasks which involves partition discovery as well.

 

Resolution

To ensure partition discovery works as expected, do the following:

 

  1. Go to CM > Hive >Configuration.
  2. Search for Hive Metastore Server Advanced Configuration Snippet (Safety Valve) for hive-site.xml.
  3. Click on + >Add the following:
    Name :--> metastore.compactor.initiator.on 
    Value :--> true
  4. Save the changes and restart.
  5. Ensure the tables have the property discover.partitions is set to True for certain tables.
288 Views
0 Kudos
Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.
Version history
Last update:
‎05-10-2021 11:33 PM
Updated by:
Top Kudoed Authors
; ;