Support Questions

Find answers, ask questions, and share your expertise
Announcements
Check out our newest addition to the community, the Cloudera Data Analytics (CDA) group hub.

HBase Quota Management

Cloudera Employee

In HDP 2.2.8 is there any way to enable quota management within HBase that would limit namespaces to a specific size for example:

For Example:

Create two namespaces and apply a Quota limit:

Namespace1: 50 TB

Table1, Table2

Namespace2 150 TB

Table3, Table4, Table5

But the sum of the tables would be allowed to use up to that limit.

Example:

Table1 + Table2 <= 50 TB

Table3 + Table4 + Table5 <= 150TB

Thank you for any advice and guidance.

1 ACCEPTED SOLUTION

Guru

There are namespace level quotas for number of tables and number of regions, and request throttling per user as documented in:

https://hbase.apache.org/book.html#_running_multiple_workloads_on_a_single_cluster

There is no table size limiting using quotas as of now. However, the maxTable, maxRegion limits are not released in Apache or HDP yet. Request throttling can be used in HDP-2.3+.

Enis

View solution in original post

2 REPLIES 2

Contributor

Hmmm, never saw requirement like this, here is a reference for hbase cluster capacity sizing, hope it helps:

http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.2.8/bk_Sys_Admin_Guides/content/ch_clust_capacit...

Guru

There are namespace level quotas for number of tables and number of regions, and request throttling per user as documented in:

https://hbase.apache.org/book.html#_running_multiple_workloads_on_a_single_cluster

There is no table size limiting using quotas as of now. However, the maxTable, maxRegion limits are not released in Apache or HDP yet. Request throttling can be used in HDP-2.3+.

Enis

Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.