Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]

Support Questions

Find answers, ask questions, and share your expertise
Announcements
Share your experience with Cloudera on G2 and get a $25 Amazon Gift card.
Hi, I'm CLEO! Something exciting is coming to the Community. Stay Tuned!

How to delete tombstone in Hbase

avatar
Explorer

Hi,

I am not able to permanently delete tombstone in Hbase.

Tombstone markers are flushed for non-MOB column family but it is not flushed for the MOB column family.

 

Any solution to delete the same so that we save some hdfs space.

 

Regards,

Satya

1 ACCEPTED SOLUTION

avatar
Super Collaborator

There is no direct method or property to disable tombstone marker. Major compacting the mob CF is the only way to go. There is a mob cleaner running on master that removes unreferenced mob files:

The period of the cleaner chore can be configured by setting hbase.master.mob.cleaner.period to a positive integer number of seconds. It defaults to running daily. You should not need to tune it unless you have a very aggressive TTL or a very high rate of MOB updates with a correspondingly high rate of non-MOB compactions.

So you can check and set the above parameter value and can manually trigger mob compaction by specifying the cf that includes mob data in hbase shell.

 

NOTE : MOBs are mostly for writing large cells that will rarely be updated or deleted but could have TTL configured for the cell or CF.

View solution in original post

5 REPLIES 5

avatar
Explorer

Can anyone help on this?

 

avatar
Explorer

I am also looking for a solution for the same problem.... Can anyone help?

avatar
Super Collaborator

The cells which are deleted will have a tombstone marker and this will get deleted once you run a major compaction on that table. it deletes records and combines Hfiles.

avatar
Explorer

This is the issue that even after running major compaction the tombstone markers were not deleted.

hbase(main):107:0* scan 'CBST:TEST', {RAW => TRUE}
ROW COLUMN+CELL
Test101 column=cfDocContent:doc, timestamp=1650962333104, type=Delete
Test102 column=cfDocContent:doc, timestamp=1650962333121, type=Delete
Test103 column=cfDocContent:doc, timestamp=1650962333136, type=Delete
Test104 column=cfDocContent:doc, timestamp=1650962333150, type=Delete
Test105 column=cfDocContent:doc, timestamp=1650962333167, type=Delete
5 row(s)
Took 0.0182 seconds
hbase(main):108:0>

avatar
Super Collaborator

There is no direct method or property to disable tombstone marker. Major compacting the mob CF is the only way to go. There is a mob cleaner running on master that removes unreferenced mob files:

The period of the cleaner chore can be configured by setting hbase.master.mob.cleaner.period to a positive integer number of seconds. It defaults to running daily. You should not need to tune it unless you have a very aggressive TTL or a very high rate of MOB updates with a correspondingly high rate of non-MOB compactions.

So you can check and set the above parameter value and can manually trigger mob compaction by specifying the cf that includes mob data in hbase shell.

 

NOTE : MOBs are mostly for writing large cells that will rarely be updated or deleted but could have TTL configured for the cell or CF.