Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]
Created 01-26-2021 04:45 AM
Hi,
I am not able to permanently delete tombstone in Hbase.
Tombstone markers are flushed for non-MOB column family but it is not flushed for the MOB column family.
Any solution to delete the same so that we save some hdfs space.
Regards,
Satya
Created 04-28-2022 10:04 AM
There is no direct method or property to disable tombstone marker. Major compacting the mob CF is the only way to go. There is a mob cleaner running on master that removes unreferenced mob files:
The period of the cleaner chore can be configured by setting hbase.master.mob.cleaner.period to a positive integer number of seconds. It defaults to running daily. You should not need to tune it unless you have a very aggressive TTL or a very high rate of MOB updates with a correspondingly high rate of non-MOB compactions.
So you can check and set the above parameter value and can manually trigger mob compaction by specifying the cf that includes mob data in hbase shell.
NOTE : MOBs are mostly for writing large cells that will rarely be updated or deleted but could have TTL configured for the cell or CF.
Created 01-27-2021 12:03 AM
Can anyone help on this?
Created 02-28-2022 04:03 AM
I am also looking for a solution for the same problem.... Can anyone help?
Created 04-28-2022 03:54 AM
The cells which are deleted will have a tombstone marker and this will get deleted once you run a major compaction on that table. it deletes records and combines Hfiles.
Created 04-28-2022 09:24 AM
This is the issue that even after running major compaction the tombstone markers were not deleted.
hbase(main):107:0* scan 'CBST:TEST', {RAW => TRUE}
ROW COLUMN+CELL
Test101 column=cfDocContent:doc, timestamp=1650962333104, type=Delete
Test102 column=cfDocContent:doc, timestamp=1650962333121, type=Delete
Test103 column=cfDocContent:doc, timestamp=1650962333136, type=Delete
Test104 column=cfDocContent:doc, timestamp=1650962333150, type=Delete
Test105 column=cfDocContent:doc, timestamp=1650962333167, type=Delete
5 row(s)
Took 0.0182 seconds
hbase(main):108:0>
Created 04-28-2022 10:04 AM
There is no direct method or property to disable tombstone marker. Major compacting the mob CF is the only way to go. There is a mob cleaner running on master that removes unreferenced mob files:
The period of the cleaner chore can be configured by setting hbase.master.mob.cleaner.period to a positive integer number of seconds. It defaults to running daily. You should not need to tune it unless you have a very aggressive TTL or a very high rate of MOB updates with a correspondingly high rate of non-MOB compactions.
So you can check and set the above parameter value and can manually trigger mob compaction by specifying the cf that includes mob data in hbase shell.
NOTE : MOBs are mostly for writing large cells that will rarely be updated or deleted but could have TTL configured for the cell or CF.