Support Questions

Find answers, ask questions, and share your expertise

HBase Quota Management

avatar
Contributor

In HDP 2.2.8 is there any way to enable quota management within HBase that would limit namespaces to a specific size for example:

For Example:

Create two namespaces and apply a Quota limit:

Namespace1: 50 TB

Table1, Table2

Namespace2 150 TB

Table3, Table4, Table5

But the sum of the tables would be allowed to use up to that limit.

Example:

Table1 + Table2 <= 50 TB

Table3 + Table4 + Table5 <= 150TB

Thank you for any advice and guidance.

1 ACCEPTED SOLUTION

avatar
Guru

There are namespace level quotas for number of tables and number of regions, and request throttling per user as documented in:

https://hbase.apache.org/book.html#_running_multiple_workloads_on_a_single_cluster

There is no table size limiting using quotas as of now. However, the maxTable, maxRegion limits are not released in Apache or HDP yet. Request throttling can be used in HDP-2.3+.

Enis

View solution in original post

2 REPLIES 2

avatar
Rising Star

Hmmm, never saw requirement like this, here is a reference for hbase cluster capacity sizing, hope it helps:

http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.2.8/bk_Sys_Admin_Guides/content/ch_clust_capacit...

avatar
Guru

There are namespace level quotas for number of tables and number of regions, and request throttling per user as documented in:

https://hbase.apache.org/book.html#_running_multiple_workloads_on_a_single_cluster

There is no table size limiting using quotas as of now. However, the maxTable, maxRegion limits are not released in Apache or HDP yet. Request throttling can be used in HDP-2.3+.

Enis