Reply
New Contributor
Posts: 4
Registered: ‎09-17-2013
Accepted Solution

hive table compaction

Havent found anything in cloudera on hive table compaction as described in

http://www.openkb.info/2015/06/hive-transaction-feature-in-hive-10.html

 

Has anyone tried this in CDH and any performance impact?

Cloudera Employee
Posts: 35
Registered: ‎08-18-2014

Re: hive table compaction

This feature is not supported in CDH yet. We consider this feature is experimental, and incomplete (only works with ORC file format).

Highlighted
Cloudera Employee
Posts: 29
Registered: ‎02-08-2015

Re: hive table compaction

Here's what the most recent version of the CDH Hive documentation says about this: http://www.cloudera.com/documentation/enterprise/latest/topics/hive.html#hive_transaction_support "Transaction (ACID) Support in Hive The CDH distribution of Hive does not support transactions (HIVE-5317). Currently, transaction support in Hive is an experimental feature that only works with the ORC file format. Cloudera recommends using the Parquet file format, which works across many tools. Merge updates in Hive tables using existing functionality, including statements such as INSERT, INSERT OVERWRITE, and CREATE TABLE AS SELECT."
New Contributor
Posts: 1
Registered: ‎02-04-2018

Re: hive table compaction

[ Edited ]

Any updates to this feature? Is it still experimental? what about parquet formats?

Announcements