Hadoop HBase nonstop Memstore flushing and compactions
Hello and thanks for reading
I have an issue with hadoop hbase
while trying to find the issue I can see below memstore flush logs for all tables and its non stop
MemstoreFlusherChore requesting flush of table 1. because K has an old edit so flush to free WALs after random delay 65889ms
022-10-29 12:22:13,176 INFO [regionserver/uhn-hw-fores201b:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of table 1. because K has an old edit so flush to free WALs after random delay 65889ms
2022-10-29 12:22:13,177 INFO [regionserver/uhn-hw-fores201b:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of tabl 2 . because K has an old edit so flush to free WALs after random delay 181952ms
2022-10-29 12:22:13,177 INFO [regionserver/uhn-hw-fores201b:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of table 3 . because K has an old edit so flush to free WALs after random delay 150462ms
2022-10-29 12:22:13,177 INFO [regionserver/uhn-hw-fores201b:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of table 4 . because K has an old edit so flush to free WALs after random delay 161958ms
This error seems complex because no documentation about error
below is random logs from same node
2022-10-29 12:21:46,170 INFO [MemStoreFlusher.1] regionserver.HRegion: Finished flush of dataSize ~6.68 MB/7002393, heapSize ~19.57 MB/20517200, currentSize=0 B/0 for ad1bd353d9ae0c52e30a935c5d06ecfa in 335ms, sequenceid=25141679, compaction requested=true
2022-10-29 12:22:02,679 INFO [MemStoreFlusher.1] regionserver.HRegion: Flushing 1/1 column families, dataSize=2.79 MB heapSize=7.22 MB
Tasks:
===========================================================
Task: Compacting K in table .
Status: RUNNING:Compacting store K
Running for 11449s
Task: Compacting K in region.
Status: RUNNING:Compacting store K
Running for 168s
Task: Compacting K in region.
Status: RUNNING:Compacting store K
Running for 159s
Task: Compacting K in region.
Status: RUNNING:Compacting store K
Running for 72s
RS Queue:
===========================================================
Compaction/Split Queue summary: compactionQueue=(longCompactions=111975:shortCompactions=35811), splitQueue=0
Compaction/Split Queue dump:
LargeCompation Queue:
Below is the worker node data






I tried to find any configuration for WAL, but seems it has been depricated
HBase Version 2.0.0.3.0.1.0-187, revision=e9fcf450949102de5069b257a6dee469b8f5aab3
Hadoop Version 3.1.1.3.0.1.0-187, revision=2820e4d6fc7ec31ac42187083ed5933c823e9784

