Hive Streaming Compaction
This is the second part of the Hive Streaming Article series. In this article we will review the issues around compacting Hive Streaming files.
One of the results o...
Have recently run into multiple issues where ORC files on hive are not getting compacted. There are a couple of parameters required to enable concat on ORC. SET hive.merge.tezfiles=true; SET h...
...xn.CompactionTxnHandler (CompactionTxnHandler.java:findNextToCompact(194)) - Unable to select next element for compaction, Deadlock found when trying to get lock; try restarting transaction
ROOT CAUSE: org.apache...
Default fs.trash.interval=0 & fs.trash.checkpoint.interval=0 indicating i.e. trash feature is disabled. What is recommended value for Production like clusters ? if these values are 0 then what is...
Havent found anything in cloudera on hive table compaction as described in http://www.openkb.info/2015/06/hive-transaction-feature-in-hive-10.html Has anyone tried this in CDH and any p...
...ransactions on the Hive instance however, I can't see any compactions running nor do any get created when I force compaction with ALTER TABLE command. I would expect compaction to run and merge these files a...
I have ORC tables created in Hive for ACID transactions and I am able to perform insert/update/delete. But the transaction files created delta* are not getting merged. When I run show compactions, i...
Probably a real simple question, but I can't seem to find the answer. What, if anything, is the impact on availability of a region during HBase maintenance tasks like major/minor compaction, r...