Support Questions
Find answers, ask questions, and share your expertise
Check out our newest addition to the community, the Cloudera Innovation Accelerator group hub.

is the hive-atlas integration transactional

Expert Contributor

Hi All,

The communication between hive to atlas through Kafka - is it transactional in nature. If Atlas update fails, does it affect the hive operation in any way?

Does all messages remain in kafka untill processed or discrded?




Expert Contributor
@Avijeet Dash, hive-atlas integration doesn't happen within the same transaction. Atlas entity create/update is done as part of post execution hooks in hive using the property - Atlas failures doesn't affect hive transaction. All hive hook messages will remain in kafka topic until processed by Atlas. Hope this helps