Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

ACID TRANSACTIONS & HIVE

ACID TRANSACTIONS & HIVE

New Contributor

Hi There,

I have gone through the blogs, docs, tutorials (links below) and concluding that ACID transactions works with Internal Hive tables with ORC format. They do not work with External Hive Tables. Please let me know if I have misunderstood and there is a way to make ACID transacitions work with External Hive Tables.

https://hortonworks.com/tutorial/using-hive-acid-transactions-to-insert-update-and-delete-data/

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.1/bk_data-access/content/ch02s05s01.html

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.2/bk_data-access/content/creating-hive-acid-t...

Many thanks.

Cheers

-Kiks.

2 REPLIES 2

Re: ACID TRANSACTIONS & HIVE

New Contributor

The general thinking is that external tables are not owned by hive and files/folders can change outside of hive's control. You can't really provide transactional guarantees under these circumstances, which is why the restriction is there. Do you really need to mark those tables external? Can you just convert them to internal?

Re: ACID TRANSACTIONS & HIVE

New Contributor

Thanks ghagleitner for the reply. It looks like we don't have a choice apart from using hive managed tables. I understand the rationale.

Don't have an account?
Coming from Hortonworks? Activate your account here