Support Questions
Find answers, ask questions, and share your expertise

is the hive-atlas integration transactional

Expert Contributor

Hi All,

The communication between hive to atlas through Kafka - is it transactional in nature. If Atlas update fails, does it affect the hive operation in any way?

Does all messages remain in kafka untill processed or discrded?

Thanks,

Avijeet

1 REPLY 1

Re: is the hive-atlas integration transactional

Expert Contributor
@Avijeet Dash, hive-atlas integration doesn't happen within the same transaction. Atlas entity create/update is done as part of post execution hooks in hive using the property - hive.exec.post.hooks. Atlas failures doesn't affect hive transaction. All hive hook messages will remain in kafka topic until processed by Atlas. Hope this helps