is the hive-atlas integration transactional

[#1]

Hi All,

The communication between hive to atlas through Kafka - is it transactional in nature. If Atlas update fails, does it affect the hive operation in any way?

Does all messages remain in kafka untill processed or discrded?

Thanks,

Avijeet

[#2]

@Avijeet Dash, hive-atlas integration doesn't happen within the same transaction. Atlas entity create/update is done as part of post execution hooks in hive using the property - hive.exec.post.hooks. Atlas failures doesn't affect hive transaction. All hive hook messages will remain in kafka topic until processed by Atlas. Hope this helps