https://community.cloudera.com/t5/Support-Questions/Does-TTL-in-Hbase-require-Major-Compaction/m-p/214170#M176085 <P>"What does "expired data is filtered out and is not written back to the compacted StoreFile." mean?"</P><P>Filtered data (by TTL) would be removed on compaction. That is what this statement means.</P><P>As to your confusion from your test, remember that there is a difference between a "minor compaction" and a "major compaction". A "major compaction" is a re-writing of all files in a region, whereas a "minor compaction" is (possibly) a subset of the files in a Region. Because (I'm guessing) you actually mean that you've disabled schedule major compactions doesn't mean that compactions will never run in your system (this is actually a really idea if you've somehow done this, by the way).</P><P>A minor compaction can remove data masked by a TTL -- this is the simple case. However, tombstones can *only* be removed when a major compaction runs. This is because the tombstone may be masking records that exist in a file which was not included in the compaction process.</P><P>Long-story short: if you want to verify why your experiment works as it does, just grep out the region identifier for your table from the RegionServer log. You should see a message INFO (if not INFO, certainly at DEBUG) which informs you that a compaction occurred on that Region, the number of input files and size and the size of the output file. Before that compaction message, the file on disk would be the full size; after, it would be the reduced size.</P><P><A href="https://hbase.apache.org/book.html#compaction" target="_blank">https://hbase.apache.org/book.html#compaction</A> does a pretty good job explaining these nuances, but feel free to ask for more clarification.</P> Thu, 22 Jun 2017 12:04:24 GMT elserj 2017-06-22T12:04:24Z