question Re: hive table compaction in Archives of Support Questions (Read Only)

hive table compaction

krish — Fri, 16 Sep 2022 10:55:14 GMT

Havent found anything in cloudera on hive table compaction as described in

http://www.openkb.info/2015/06/hive-transaction-feature-in-hive-10.html

Has anyone tried this in CDH and any performance impact?

Re: hive table compaction

yshi — Sat, 04 Feb 2017 10:03:23 GMT

This feature is not supported in CDH yet. We consider this feature is experimental, and incomplete (only works with ORC file format).

Re: hive table compaction

bbreak — Wed, 08 Feb 2017 21:38:38 GMT

Here's what the most recent version of the CDH Hive documentation says about this: http://www.cloudera.com/documentation/enterprise/latest/topics/hive.html#hive_transaction_support "Transaction (ACID) Support in Hive The CDH distribution of Hive does not support transactions (HIVE-5317). Currently, transaction support in Hive is an experimental feature that only works with the ORC file format. Cloudera recommends using the Parquet file format, which works across many tools. Merge updates in Hive tables using existing functionality, including statements such as INSERT, INSERT OVERWRITE, and CREATE TABLE AS SELECT."

Re: hive table compaction

dhmadhu — Fri, 21 Dec 2018 10:14:59 GMT

Any updates to this feature? Is it still experimental? what about parquet formats?