Support Questions
Find answers, ask questions, and share your expertise

ACID TRANSACTIONS & HIVE

ACID TRANSACTIONS & HIVE

Explorer

Hi There,

I have gone through the blogs, docs, tutorials (links below) and concluding that ACID transactions works with Internal Hive tables with ORC format. They do not work with External Hive Tables. Please let me know if I have misunderstood and there is a way to make ACID transacitions work with External Hive Tables.

https://hortonworks.com/tutorial/using-hive-acid-transactions-to-insert-update-and-delete-data/

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.1/bk_data-access/content/ch02s05s01.html

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.2/bk_data-access/content/creating-hive-acid-t...

Many thanks.

Cheers

-Kiks.

2 REPLIES 2
Highlighted

Re: ACID TRANSACTIONS & HIVE

Explorer

The general thinking is that external tables are not owned by hive and files/folders can change outside of hive's control. You can't really provide transactional guarantees under these circumstances, which is why the restriction is there. Do you really need to mark those tables external? Can you just convert them to internal?

Highlighted

Re: ACID TRANSACTIONS & HIVE

Explorer

Thanks ghagleitner for the reply. It looks like we don't have a choice apart from using hive managed tables. I understand the rationale.