Reply
Highlighted
New Contributor
Posts: 1
Registered: ‎06-02-2014

Dynamically Adding Hive Partitions and Loading New Files into Existing Partitions

Does functionality currently exist in the Kite SDK's HCatalog module to automtically cause Hive tables recognize the addition of new datasets and/or new partitions? A previous post indicates that HCatalog will certainly allow you to post new data into an existing or new partition folder in HDFS, but it seems Hive's metastore still needs manual updating either using Hive's LOAD command for new data files, or the ADD PARTITION commands for new partition folders and their child files (the post mentioning this can be found here: http://community.cloudera.com/t5/Kite-SDK-includes-Morphlines/Dynamically-add-partitions-to-HCatalog...).