Support Questions

Find answers, ask questions, and share your expertise
Celebrating as our community reaches 100,000 members! Thank you!

How Atlas is notified when there is a change in any data source e.g Hive?

Rising Star

How Hive notifies Atlas about any DML/DDL operation in Atlas against which Atlas generates lineage? What is the whole flow? and what is the information that Hive sends to Atlas?


Expert Contributor

@Saba Baig, Hive have the notion of post execution hooks which handles hive events and messages. Any Hive event triggers a hook message (post execution hook) and Atlas receives and processes the hook message. When table B is created from table A - a hook message is triggered and sent out about this event and atlas updates the related entities - hive_table, hive_db. This will also be used to track lineage and other hive event information in atlas.