- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
HBase status command meaning
- Labels:
-
Apache HBase
Created on ‎02-22-2016 01:53 AM - edited ‎09-16-2022 03:05 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hello,
I'm tring to understand the HBase status command meaning. However, I can't find any documentation on this ...
hbase(main):003:0> status 4 servers, 0 dead, 487.2500 average load
hbase(main):004:0> status 'replication' 4 servers, 0 dead, 512.0000 average load
hbase(main):006:0> status 'summary'
4 servers, 0 dead, 512.0000 average load
- is the average load in byte?/kb?
- the average is done on each day/ week?
- why is the average different than when I do only status and the same on status 'summary' and status 'replication' ?
status 'simple' 4 live servers ip1:60020 1456128551442 requestsPerSecond=0.0, numberOfOnlineRegions=216, usedHeapMB=1963, maxHeapMB=4062, numberOfStores=216, numberOfStorefiles=5321, storefileUncompressedSizeMB=133145, storefileSizeMB=31861, compressionRatio=0,2393, memstoreSizeMB=0, storefileIndexSizeMB=43, readRequestsCount=88432, writeRequestsCount=0, rootIndexSizeKB=64669, totalStaticIndexSizeKB=503682, totalStaticBloomSizeKB=17227, totalCompactingKVs=0, currentCompactedKVs=0, compactionProgressPct=NaN, coprocessors=[] ip2:60020 1456128544596 requestsPerSecond=0.0, numberOfOnlineRegions=631, usedHeapMB=2778, maxHeapMB=4062, numberOfStores=631, numberOfStorefiles=16192, storefileUncompressedSizeMB=293264, storefileSizeMB=75410, compressionRatio=0,2571, memstoreSizeMB=0, storefileIndexSizeMB=92, readRequestsCount=266918, writeRequestsCount=0, rootIndexSizeKB=158970, totalStaticIndexSizeKB=1215591, totalStaticBloomSizeKB=35553, totalCompactingKVs=0, currentCompactedKVs=0, compactionProgressPct=NaN, coprocessors=[] ip3:60020 1456128568835 requestsPerSecond=0.0, numberOfOnlineRegions=489, usedHeapMB=2520, maxHeapMB=4062, numberOfStores=489, numberOfStorefiles=12905, storefileUncompressedSizeMB=279315, storefileSizeMB=69048, compressionRatio=0,2472, memstoreSizeMB=0, storefileIndexSizeMB=91, readRequestsCount=751324, writeRequestsCount=0, rootIndexSizeKB=144189, totalStaticIndexSizeKB=930584, totalStaticBloomSizeKB=26132, totalCompactingKVs=0, currentCompactedKVs=0, compactionProgressPct=NaN, coprocessors=[] ip4:60020 1456128516858 requestsPerSecond=174.0, numberOfOnlineRegions=712, usedHeapMB=2893, maxHeapMB=4062, numberOfStores=712, numberOfStorefiles=17456, storefileUncompressedSizeMB=617248, storefileSizeMB=131324, compressionRatio=0,2128, memstoreSizeMB=1, storefileIndexSizeMB=98, readRequestsCount=22001272, writeRequestsCount=2047, rootIndexSizeKB=167594, totalStaticIndexSizeKB=1776285, totalStaticBloomSizeKB=149625, totalCompactingKVs=0, currentCompactedKVs=0, compactionProgressPct=NaN, coprocessors=[] 0 dead servers Aggregate load: 174, regions: 2048
- what is the meaning of the 'aggregate load' indicator?
status 'detailed'
"test_all,,1453275538489.ed10387c718e4b42573b6720a407b155."
numberOfStores=1, numberOfStorefiles=1, storefileUncompressedSizeMB=0, storefileSizeMB=0, memstoreSizeMB=0, storefileIndexSizeMB=0, readRequestsCount=0, writeRequestsCount=0, rootIndexSizeKB=1, totalStaticIndexSizeKB=0, totalStaticBloomSizeKB=0, totalCompactingKVs=0, currentCompactedKVs=0, compactionProgressPct=NaN
...
- does the compactionProgressPct correesponds to major_compact ?
- What is the meaning of:
- totalCompactingKVs
- currentCompactedKVs
Thank you!
Created ‎02-22-2016 02:20 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
> - the average is done on each day/ week?
It is the average of number of regions hosted by each RS. Its computed when
you run the status command.
> - why is the average different than when I do only status and the same on
status 'summary' and status 'replication' ?
Am not sure I follow. Could you post the observed difference?
> - what is the meaning of the 'aggregate load' indicator?
The load is aggregated from the number of requests per second (
requestsPerSecond)
> - does the compactionProgressPct correesponds to major_compact ?
Yes, and it measures the progress for a specific major compacting region at
the point of time of running the status command.
> - What is the meaning of: totalCompactingKVs / currentCompactedKVs
Compactions cause rewrites of KV pairs inside HFiles, into new
(fewer/single) HFiles. These numbers track the total KVs participating in
the tracked compaction, and the count of how many that have completed
persistence so far.
Created ‎02-22-2016 02:20 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
> - the average is done on each day/ week?
It is the average of number of regions hosted by each RS. Its computed when
you run the status command.
> - why is the average different than when I do only status and the same on
status 'summary' and status 'replication' ?
Am not sure I follow. Could you post the observed difference?
> - what is the meaning of the 'aggregate load' indicator?
The load is aggregated from the number of requests per second (
requestsPerSecond)
> - does the compactionProgressPct correesponds to major_compact ?
Yes, and it measures the progress for a specific major compacting region at
the point of time of running the status command.
> - What is the meaning of: totalCompactingKVs / currentCompactedKVs
Compactions cause rewrites of KV pairs inside HFiles, into new
(fewer/single) HFiles. These numbers track the total KVs participating in
the tracked compaction, and the count of how many that have completed
persistence so far.
Created ‎02-22-2016 02:29 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I forgot to mention one question , what is the difference in the information that I get in the commands status and status 'replication'?
