Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

HBase status command meaning

avatar
Champion Alumni

Hello,

 

I'm tring to understand the HBase status command meaning. However, I can't find any documentation on this ...

 

 

hbase(main):003:0> status
4 servers, 0 dead, 487.2500 average load
hbase(main):004:0> status 'replication'
4 servers, 0 dead, 512.0000 average load
hbase(main):006:0> status 'summary'
4 servers, 0 dead, 512.0000 average load

- is the average load in byte?/kb?

- the average is done on each day/ week?

- why is the average different than when I do only status and the same on status 'summary' and status 'replication' ?

 

 

 

status 'simple'
4 live servers
    ip1:60020 1456128551442
        requestsPerSecond=0.0, numberOfOnlineRegions=216, usedHeapMB=1963, maxHeapMB=4062, numberOfStores=216, numberOfStorefiles=5321, storefileUncompressedSizeMB=133145, storefileSizeMB=31861, compressionRatio=0,2393, memstoreSizeMB=0, storefileIndexSizeMB=43, readRequestsCount=88432, writeRequestsCount=0, rootIndexSizeKB=64669, totalStaticIndexSizeKB=503682, totalStaticBloomSizeKB=17227, totalCompactingKVs=0, currentCompactedKVs=0, compactionProgressPct=NaN, coprocessors=[]
    ip2:60020 1456128544596
        requestsPerSecond=0.0, numberOfOnlineRegions=631, usedHeapMB=2778, maxHeapMB=4062, numberOfStores=631, numberOfStorefiles=16192, storefileUncompressedSizeMB=293264, storefileSizeMB=75410, compressionRatio=0,2571, memstoreSizeMB=0, storefileIndexSizeMB=92, readRequestsCount=266918, writeRequestsCount=0, rootIndexSizeKB=158970, totalStaticIndexSizeKB=1215591, totalStaticBloomSizeKB=35553, totalCompactingKVs=0, currentCompactedKVs=0, compactionProgressPct=NaN, coprocessors=[]
    ip3:60020 1456128568835
        requestsPerSecond=0.0, numberOfOnlineRegions=489, usedHeapMB=2520, maxHeapMB=4062, numberOfStores=489, numberOfStorefiles=12905, storefileUncompressedSizeMB=279315, storefileSizeMB=69048, compressionRatio=0,2472, memstoreSizeMB=0, storefileIndexSizeMB=91, readRequestsCount=751324, writeRequestsCount=0, rootIndexSizeKB=144189, totalStaticIndexSizeKB=930584, totalStaticBloomSizeKB=26132, totalCompactingKVs=0, currentCompactedKVs=0, compactionProgressPct=NaN, coprocessors=[]
    ip4:60020 1456128516858
        requestsPerSecond=174.0, numberOfOnlineRegions=712, usedHeapMB=2893, maxHeapMB=4062, numberOfStores=712, numberOfStorefiles=17456, storefileUncompressedSizeMB=617248, storefileSizeMB=131324, compressionRatio=0,2128, memstoreSizeMB=1, storefileIndexSizeMB=98, readRequestsCount=22001272, writeRequestsCount=2047, rootIndexSizeKB=167594, totalStaticIndexSizeKB=1776285, totalStaticBloomSizeKB=149625, totalCompactingKVs=0, currentCompactedKVs=0, compactionProgressPct=NaN, coprocessors=[]
0 dead servers
Aggregate load: 174, regions: 2048

- what is the meaning of the 'aggregate load' indicator?

 

 

 status 'detailed'
 "test_all,,1453275538489.ed10387c718e4b42573b6720a407b155."
            numberOfStores=1, numberOfStorefiles=1, storefileUncompressedSizeMB=0, storefileSizeMB=0, memstoreSizeMB=0, storefileIndexSizeMB=0, readRequestsCount=0, writeRequestsCount=0, rootIndexSizeKB=1, totalStaticIndexSizeKB=0, totalStaticBloomSizeKB=0, totalCompactingKVs=0, currentCompactedKVs=0, compactionProgressPct=NaN
...

- does the compactionProgressPct correesponds to major_compact ?

- What is the meaning of:

  •              totalCompactingKVs
  •              currentCompactedKVs

 

 

Thank you!

 

 

 

 

 

 

 

 

GHERMAN Alina
1 ACCEPTED SOLUTION

avatar
Mentor
> - is the average load in byte?/kb?
> - the average is done on each day/ week?

It is the average of number of regions hosted by each RS. Its computed when
you run the status command.

> - why is the average different than when I do only status and the same on
status 'summary' and status 'replication' ?

Am not sure I follow. Could you post the observed difference?

> - what is the meaning of the 'aggregate load' indicator?

The load is aggregated from the number of requests per second (
requestsPerSecond)

> - does the compactionProgressPct correesponds to major_compact ?

Yes, and it measures the progress for a specific major compacting region at
the point of time of running the status command.

> - What is the meaning of: totalCompactingKVs / currentCompactedKVs
Compactions cause rewrites of KV pairs inside HFiles, into new
(fewer/single) HFiles. These numbers track the total KVs participating in
the tracked compaction, and the count of how many that have completed
persistence so far.

View solution in original post

2 REPLIES 2

avatar
Mentor
> - is the average load in byte?/kb?
> - the average is done on each day/ week?

It is the average of number of regions hosted by each RS. Its computed when
you run the status command.

> - why is the average different than when I do only status and the same on
status 'summary' and status 'replication' ?

Am not sure I follow. Could you post the observed difference?

> - what is the meaning of the 'aggregate load' indicator?

The load is aggregated from the number of requests per second (
requestsPerSecond)

> - does the compactionProgressPct correesponds to major_compact ?

Yes, and it measures the progress for a specific major compacting region at
the point of time of running the status command.

> - What is the meaning of: totalCompactingKVs / currentCompactedKVs
Compactions cause rewrites of KV pairs inside HFiles, into new
(fewer/single) HFiles. These numbers track the total KVs participating in
the tracked compaction, and the count of how many that have completed
persistence so far.

avatar
Champion Alumni
There was a difference in the amount of average load. Since it's computed when we do the command, it may vary..
I forgot to mention one question , what is the difference in the information that I get in the commands status and status 'replication'?
GHERMAN Alina