Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

HBase status command meaning

Solved Go to solution

HBase status command meaning

Champion Alumni

Hello,

 

I'm tring to understand the HBase status command meaning. However, I can't find any documentation on this ...

 

 

hbase(main):003:0> status
4 servers, 0 dead, 487.2500 average load
hbase(main):004:0> status 'replication'
4 servers, 0 dead, 512.0000 average load
hbase(main):006:0> status 'summary'
4 servers, 0 dead, 512.0000 average load

- is the average load in byte?/kb?

- the average is done on each day/ week?

- why is the average different than when I do only status and the same on status 'summary' and status 'replication' ?

 

 

 

status 'simple'
4 live servers
    ip1:60020 1456128551442
        requestsPerSecond=0.0, numberOfOnlineRegions=216, usedHeapMB=1963, maxHeapMB=4062, numberOfStores=216, numberOfStorefiles=5321, storefileUncompressedSizeMB=133145, storefileSizeMB=31861, compressionRatio=0,2393, memstoreSizeMB=0, storefileIndexSizeMB=43, readRequestsCount=88432, writeRequestsCount=0, rootIndexSizeKB=64669, totalStaticIndexSizeKB=503682, totalStaticBloomSizeKB=17227, totalCompactingKVs=0, currentCompactedKVs=0, compactionProgressPct=NaN, coprocessors=[]
    ip2:60020 1456128544596
        requestsPerSecond=0.0, numberOfOnlineRegions=631, usedHeapMB=2778, maxHeapMB=4062, numberOfStores=631, numberOfStorefiles=16192, storefileUncompressedSizeMB=293264, storefileSizeMB=75410, compressionRatio=0,2571, memstoreSizeMB=0, storefileIndexSizeMB=92, readRequestsCount=266918, writeRequestsCount=0, rootIndexSizeKB=158970, totalStaticIndexSizeKB=1215591, totalStaticBloomSizeKB=35553, totalCompactingKVs=0, currentCompactedKVs=0, compactionProgressPct=NaN, coprocessors=[]
    ip3:60020 1456128568835
        requestsPerSecond=0.0, numberOfOnlineRegions=489, usedHeapMB=2520, maxHeapMB=4062, numberOfStores=489, numberOfStorefiles=12905, storefileUncompressedSizeMB=279315, storefileSizeMB=69048, compressionRatio=0,2472, memstoreSizeMB=0, storefileIndexSizeMB=91, readRequestsCount=751324, writeRequestsCount=0, rootIndexSizeKB=144189, totalStaticIndexSizeKB=930584, totalStaticBloomSizeKB=26132, totalCompactingKVs=0, currentCompactedKVs=0, compactionProgressPct=NaN, coprocessors=[]
    ip4:60020 1456128516858
        requestsPerSecond=174.0, numberOfOnlineRegions=712, usedHeapMB=2893, maxHeapMB=4062, numberOfStores=712, numberOfStorefiles=17456, storefileUncompressedSizeMB=617248, storefileSizeMB=131324, compressionRatio=0,2128, memstoreSizeMB=1, storefileIndexSizeMB=98, readRequestsCount=22001272, writeRequestsCount=2047, rootIndexSizeKB=167594, totalStaticIndexSizeKB=1776285, totalStaticBloomSizeKB=149625, totalCompactingKVs=0, currentCompactedKVs=0, compactionProgressPct=NaN, coprocessors=[]
0 dead servers
Aggregate load: 174, regions: 2048

- what is the meaning of the 'aggregate load' indicator?

 

 

 status 'detailed'
 "test_all,,1453275538489.ed10387c718e4b42573b6720a407b155."
            numberOfStores=1, numberOfStorefiles=1, storefileUncompressedSizeMB=0, storefileSizeMB=0, memstoreSizeMB=0, storefileIndexSizeMB=0, readRequestsCount=0, writeRequestsCount=0, rootIndexSizeKB=1, totalStaticIndexSizeKB=0, totalStaticBloomSizeKB=0, totalCompactingKVs=0, currentCompactedKVs=0, compactionProgressPct=NaN
...

- does the compactionProgressPct correesponds to major_compact ?

- What is the meaning of:

  •              totalCompactingKVs
  •              currentCompactedKVs

 

 

Thank you!

 

 

 

 

 

 

 

 

GHERMAN Alina
1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted

Re: HBase status command meaning

Master Guru
> - is the average load in byte?/kb?
> - the average is done on each day/ week?

It is the average of number of regions hosted by each RS. Its computed when
you run the status command.

> - why is the average different than when I do only status and the same on
status 'summary' and status 'replication' ?

Am not sure I follow. Could you post the observed difference?

> - what is the meaning of the 'aggregate load' indicator?

The load is aggregated from the number of requests per second (
requestsPerSecond)

> - does the compactionProgressPct correesponds to major_compact ?

Yes, and it measures the progress for a specific major compacting region at
the point of time of running the status command.

> - What is the meaning of: totalCompactingKVs / currentCompactedKVs
Compactions cause rewrites of KV pairs inside HFiles, into new
(fewer/single) HFiles. These numbers track the total KVs participating in
the tracked compaction, and the count of how many that have completed
persistence so far.
2 REPLIES 2
Highlighted

Re: HBase status command meaning

Master Guru
> - is the average load in byte?/kb?
> - the average is done on each day/ week?

It is the average of number of regions hosted by each RS. Its computed when
you run the status command.

> - why is the average different than when I do only status and the same on
status 'summary' and status 'replication' ?

Am not sure I follow. Could you post the observed difference?

> - what is the meaning of the 'aggregate load' indicator?

The load is aggregated from the number of requests per second (
requestsPerSecond)

> - does the compactionProgressPct correesponds to major_compact ?

Yes, and it measures the progress for a specific major compacting region at
the point of time of running the status command.

> - What is the meaning of: totalCompactingKVs / currentCompactedKVs
Compactions cause rewrites of KV pairs inside HFiles, into new
(fewer/single) HFiles. These numbers track the total KVs participating in
the tracked compaction, and the count of how many that have completed
persistence so far.

Re: HBase status command meaning

Champion Alumni
There was a difference in the amount of average load. Since it's computed when we do the command, it may vary..
I forgot to mention one question , what is the difference in the information that I get in the commands status and status 'replication'?
GHERMAN Alina
Don't have an account?
Coming from Hortonworks? Activate your account here