- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
HBase Quota Management
Created ‎10-21-2015 04:47 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
In HDP 2.2.8 is there any way to enable quota management within HBase that would limit namespaces to a specific size for example:
For Example:
Create two namespaces and apply a Quota limit:
Namespace1: 50 TB
Table1, Table2
Namespace2 150 TB
Table3, Table4, Table5
But the sum of the tables would be allowed to use up to that limit.
Example:
Table1 + Table2 <= 50 TB
Table3 + Table4 + Table5 <= 150TB
Thank you for any advice and guidance.
Created ‎10-21-2015 08:27 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
There are namespace level quotas for number of tables and number of regions, and request throttling per user as documented in:
https://hbase.apache.org/book.html#_running_multiple_workloads_on_a_single_cluster
There is no table size limiting using quotas as of now. However, the maxTable, maxRegion limits are not released in Apache or HDP yet. Request throttling can be used in HDP-2.3+.
Enis
Created ‎10-21-2015 05:07 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hmmm, never saw requirement like this, here is a reference for hbase cluster capacity sizing, hope it helps:
Created ‎10-21-2015 08:27 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
There are namespace level quotas for number of tables and number of regions, and request throttling per user as documented in:
https://hbase.apache.org/book.html#_running_multiple_workloads_on_a_single_cluster
There is no table size limiting using quotas as of now. However, the maxTable, maxRegion limits are not released in Apache or HDP yet. Request throttling can be used in HDP-2.3+.
Enis
