Reply
Champion
Posts: 760
Registered: ‎05-16-2016

Re: Update and Delete are not working in Hive ?

[ Edited ]

@AlexMulti

 

Deletes can only be performed on tables that support ACID. More over your tables's file format should be ORC

Below are the properties that needs to be set .

 

hive.support.concurrency	true (default is false)
hive.enforce.bucketing	true (default is false) (Not required as of Hive 2.0)
hive.exec.dynamic.partition.mode	nonstrict (default is strict)

Also i would suggest you to take look into  kudu. 

 

Reference https://cwiki.apache.org/confluence/display/Hive/Hive+Transactions#HiveTransactions-NewConfiguration...

Highlighted
Explorer
Posts: 8
Registered: ‎10-26-2017

Re: Update and Delete are not working in Hive ?

@csgunaThank you for the reply!

 

I am using Parquet and you are right, it is not supported for UPDATE and DELETE operations. Only ORC is supported.

 

@syamsriI suggest the last post from csguna should be marked as the correct answer.

Explorer
Posts: 36
Registered: ‎01-08-2017

Re: Update and Delete are not working in Hive ?

Oh ok syam i got. I did the installation part manually.

Cloudera Employee
Posts: 89
Registered: ‎11-20-2015

Re: Update and Delete are not working in Hive ?

The CDH distribution of Hive does not support transactions (HIVE-5317). Currently, transaction support in Hive is an experimental feature that only works with the ORC file format. Cloudera recommends using the Parquet file format, which works across many tools. Merge updates in Hive tables using existing functionality, including statements such as INSERTINSERT OVERWRITE, and CREATE TABLE AS SELECT.

 

https://www.cloudera.com/documentation/enterprise/latest/topics/hive_ingesting_and_querying_data.htm...

 

If you require these features, please inquire about Apache Kudu.

 

Kudu is storage for fast analytics on fast data—providing a combination of fast inserts and updates alongside efficient columnar scans to enable multiple real-time analytic workloads across a single storage layer.

 

https://www.cloudera.com/products/open-source/apache-hadoop/apache-kudu.html

New Contributor
Posts: 1
Registered: ‎09-11-2018

Re: Update and Delete are not working in Hive ?

Please check the link https://hortonworks.com/blog/update-hive-tables-easy-way/ hope this helps.

Announcements