how to delete HBASE data completely from hdfs path also

[#1]

Hi Team

We have created the HBASE MOB tables and whenever we are deleting the data from hbase tables it's showing deleted from table but the hdfs size is not decreasing even after major compaction.

Can anyone give any idea how to delete it completely so that there should be some space free at hdfs level.

Regards,

Satya

[#2]

Hello @Satya_Singh 

Thanks for using Cloudera Community. Based on the Post, Your team is deleted data from a HBase MoB Table & experiencing no HDFS Size reduction post Compaction as well. 

Wish to confirm whether your Team is checking the Size of the Table within the Table Level Directory (/hbase/data/<NameSpace>/<Table>) after the MajorCompaction. Additionally, Check the HBase Data Directory recursively for the concerned Table Name (hdfs dfs -ls -R /hbase | grep <TableName>) to confirm if the concerned Table data is being persisted within the Archive Directory. If the Table Data is being moved to Archive Directory, Check the HBase Master Logs for Cleanup details post TTL. Else, enable HBase Master Trace Logging to fetch granular details on the Cleanup activities pertaining to the Archive Directory. 

- Smarak

[#3]

@smdas 

Yes we are checking the size of the table within the table level directory.

hdfs dfs -du -h -s /apps/hbase/data/mobdir/data/OBST/DOCUMENT_CONTENT/b8e8a5fee4eXX/cfDocContent.

This is the table structure.

create 'MOB:TEST',

{NAME => 'cfDocContent', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'FAST_DIFF', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE=> 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', IS_MOB => 'true', COMPRESSION => 'SNAPPY', BLOCKCACHE=> 'true', BLOCKSIZE => '65536'}

,

{NAME => 'cfMetadata', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE=> 'false', DATA_BLOCK_ENCODING => 'FAST_DIFF', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'SNAPPY', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}

Satya