question Re: Does Hive 1.1.0 on CDH 5.12 support delete and update? in Archives of Support Questions (Read Only)

Does Hive 1.1.0 on CDH 5.12 support delete and update?

praveenms91 — Fri, 16 Sep 2022 12:55:11 GMT

Does Hive 1.1.0 on CDH 5.12 support delete and update? If not can we apply the backport patches ? Where can one find the required patched for those functionality?

Re: Does Hive 1.1.0 on CDH 5.12 support delete and update?

GeKas — Thu, 01 Mar 2018 13:38:32 GMT

What do you mean delete?

If you mean to delete a record, this is only supported if you have Kudu as storage and only through Impala, as (at least as far as I know) Hive cannot operate on kudu tables.

Re: Does Hive 1.1.0 on CDH 5.12 support delete and update?

praveenms91 — Thu, 01 Mar 2018 13:48:03 GMT

Thanks for the reply. Yes I meant deleting a record in a table stored as orc or parquet.

Re: Does Hive 1.1.0 on CDH 5.12 support delete and update?

csguna — Sat, 03 Mar 2018 01:46:04 GMT

@praveenms91 @GeKas

From Hive 0.14 version it supports UPDATE and Delete operations

Update statement can only be fired against table only if that supports Transcation ACID

(Pre-requistes )

Limitations

Only rows that match the WHERE clause will be updated.
Partitioning columns and Bucketing  cannot be updated.

Hive Transcation - Reference

https://cwiki.apache.org/confluence/display/Hive/Hive+Transactions

Re: Does Hive 1.1.0 on CDH 5.12 support delete and update?

praveenms91 — Sat, 03 Mar 2018 01:58:54 GMT

Does it support on Cloudera 5.12 which does not have hive 5317.? Could you
please confirm it.

Re: Does Hive 1.1.0 on CDH 5.12 support delete and update?

csguna — Sat, 03 Mar 2018 02:01:50 GMT

You should be runining the below version of HIVE since you had mentioned cdh 5.12

hive-1.1.0+cdh5.12.2+1218

yes it should work.

Re: Does Hive 1.1.0 on CDH 5.12 support delete and update?

GeKas — Sat, 03 Mar 2018 08:28:47 GMT

@csgunaYou are correct, but we are talking about CDH.

I have not tried it, but according to documentation, is not supported even on CDH5.14. It is clearly mentioned in the link below.

https://www.cloudera.com/documentation/enterprise/latest/topics/hive_ingesting_and_querying_data.html#hive_transaction_support

Re: Does Hive 1.1.0 on CDH 5.12 support delete and update?

GeKas — Sat, 03 Mar 2018 08:37:22 GMT

Just to add on that. I don't believe Cloudera will add this patch. The most probable is to wait for Hive to support Kudu, eg. the https://issues.apache.org/jira/browse/HIVE-12971 was a try, but seems abandoned for long period.

Re: Does Hive 1.1.0 on CDH 5.12 support delete and update?

csguna — Sun, 04 Mar 2018 17:57:49 GMT

@GeKas I had tried delete but the limitation is it only supports on ORC file format . (Cloudera says its not production ready) . But in one of our lower enviroment we are using without any issue until now.

Should have mentioned about the limitation that comes with. appreciate your pointer 🙂