Reply
Champion Alumni
Posts: 196
Registered: ‎11-18-2014
Accepted Solution

HBase status command meaning

Hello,

 

I'm tring to understand the HBase status command meaning. However, I can't find any documentation on this ...

 

 

hbase(main):003:0> status
4 servers, 0 dead, 487.2500 average load
hbase(main):004:0> status 'replication'
4 servers, 0 dead, 512.0000 average load
hbase(main):006:0> status 'summary'
4 servers, 0 dead, 512.0000 average load

- is the average load in byte?/kb?

- the average is done on each day/ week?

- why is the average different than when I do only status and the same on status 'summary' and status 'replication' ?

 

 

 

status 'simple'
4 live servers
    ip1:60020 1456128551442
        requestsPerSecond=0.0, numberOfOnlineRegions=216, usedHeapMB=1963, maxHeapMB=4062, numberOfStores=216, numberOfStorefiles=5321, storefileUncompressedSizeMB=133145, storefileSizeMB=31861, compressionRatio=0,2393, memstoreSizeMB=0, storefileIndexSizeMB=43, readRequestsCount=88432, writeRequestsCount=0, rootIndexSizeKB=64669, totalStaticIndexSizeKB=503682, totalStaticBloomSizeKB=17227, totalCompactingKVs=0, currentCompactedKVs=0, compactionProgressPct=NaN, coprocessors=[]
    ip2:60020 1456128544596
        requestsPerSecond=0.0, numberOfOnlineRegions=631, usedHeapMB=2778, maxHeapMB=4062, numberOfStores=631, numberOfStorefiles=16192, storefileUncompressedSizeMB=293264, storefileSizeMB=75410, compressionRatio=0,2571, memstoreSizeMB=0, storefileIndexSizeMB=92, readRequestsCount=266918, writeRequestsCount=0, rootIndexSizeKB=158970, totalStaticIndexSizeKB=1215591, totalStaticBloomSizeKB=35553, totalCompactingKVs=0, currentCompactedKVs=0, compactionProgressPct=NaN, coprocessors=[]
    ip3:60020 1456128568835
        requestsPerSecond=0.0, numberOfOnlineRegions=489, usedHeapMB=2520, maxHeapMB=4062, numberOfStores=489, numberOfStorefiles=12905, storefileUncompressedSizeMB=279315, storefileSizeMB=69048, compressionRatio=0,2472, memstoreSizeMB=0, storefileIndexSizeMB=91, readRequestsCount=751324, writeRequestsCount=0, rootIndexSizeKB=144189, totalStaticIndexSizeKB=930584, totalStaticBloomSizeKB=26132, totalCompactingKVs=0, currentCompactedKVs=0, compactionProgressPct=NaN, coprocessors=[]
    ip4:60020 1456128516858
        requestsPerSecond=174.0, numberOfOnlineRegions=712, usedHeapMB=2893, maxHeapMB=4062, numberOfStores=712, numberOfStorefiles=17456, storefileUncompressedSizeMB=617248, storefileSizeMB=131324, compressionRatio=0,2128, memstoreSizeMB=1, storefileIndexSizeMB=98, readRequestsCount=22001272, writeRequestsCount=2047, rootIndexSizeKB=167594, totalStaticIndexSizeKB=1776285, totalStaticBloomSizeKB=149625, totalCompactingKVs=0, currentCompactedKVs=0, compactionProgressPct=NaN, coprocessors=[]
0 dead servers
Aggregate load: 174, regions: 2048

- what is the meaning of the 'aggregate load' indicator?

 

 

 status 'detailed'
 "test_all,,1453275538489.ed10387c718e4b42573b6720a407b155."
            numberOfStores=1, numberOfStorefiles=1, storefileUncompressedSizeMB=0, storefileSizeMB=0, memstoreSizeMB=0, storefileIndexSizeMB=0, readRequestsCount=0, writeRequestsCount=0, rootIndexSizeKB=1, totalStaticIndexSizeKB=0, totalStaticBloomSizeKB=0, totalCompactingKVs=0, currentCompactedKVs=0, compactionProgressPct=NaN
...

- does the compactionProgressPct correesponds to major_compact ?

- What is the meaning of:

  •              totalCompactingKVs
  •              currentCompactedKVs

 

 

Thank you!

 

 

 

 

 

 

 

 

GHERMAN Alina
Highlighted
Posts: 1,903
Kudos: 436
Solutions: 307
Registered: ‎07-31-2013

Re: HBase status command meaning

> - is the average load in byte?/kb?
> - the average is done on each day/ week?

It is the average of number of regions hosted by each RS. Its computed when
you run the status command.

> - why is the average different than when I do only status and the same on
status 'summary' and status 'replication' ?

Am not sure I follow. Could you post the observed difference?

> - what is the meaning of the 'aggregate load' indicator?

The load is aggregated from the number of requests per second (
requestsPerSecond)

> - does the compactionProgressPct correesponds to major_compact ?

Yes, and it measures the progress for a specific major compacting region at
the point of time of running the status command.

> - What is the meaning of: totalCompactingKVs / currentCompactedKVs
Compactions cause rewrites of KV pairs inside HFiles, into new
(fewer/single) HFiles. These numbers track the total KVs participating in
the tracked compaction, and the count of how many that have completed
persistence so far.
Champion Alumni
Posts: 196
Registered: ‎11-18-2014

Re: HBase status command meaning

There was a difference in the amount of average load. Since it's computed when we do the command, it may vary..
I forgot to mention one question , what is the difference in the information that I get in the commands status and status 'replication'?
GHERMAN Alina