Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]

Archives of Support Questions (Read Only)

This is an archived board for historical reference. Information and links may no longer be available or relevant
Announcements
This board is archived and read-only for historical reference. To ask a new question, please post a new topic on the appropriate active board.

HBase Quota Management

avatar
Contributor

In HDP 2.2.8 is there any way to enable quota management within HBase that would limit namespaces to a specific size for example:

For Example:

Create two namespaces and apply a Quota limit:

Namespace1: 50 TB

Table1, Table2

Namespace2 150 TB

Table3, Table4, Table5

But the sum of the tables would be allowed to use up to that limit.

Example:

Table1 + Table2 <= 50 TB

Table3 + Table4 + Table5 <= 150TB

Thank you for any advice and guidance.

1 ACCEPTED SOLUTION

avatar
Guru

There are namespace level quotas for number of tables and number of regions, and request throttling per user as documented in:

https://hbase.apache.org/book.html#_running_multiple_workloads_on_a_single_cluster

There is no table size limiting using quotas as of now. However, the maxTable, maxRegion limits are not released in Apache or HDP yet. Request throttling can be used in HDP-2.3+.

Enis

View solution in original post

2 REPLIES 2

avatar
Rising Star

Hmmm, never saw requirement like this, here is a reference for hbase cluster capacity sizing, hope it helps:

http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.2.8/bk_Sys_Admin_Guides/content/ch_clust_capacit...

avatar
Guru

There are namespace level quotas for number of tables and number of regions, and request throttling per user as documented in:

https://hbase.apache.org/book.html#_running_multiple_workloads_on_a_single_cluster

There is no table size limiting using quotas as of now. However, the maxTable, maxRegion limits are not released in Apache or HDP yet. Request throttling can be used in HDP-2.3+.

Enis