Skip to main content
Malvin
Malvin
Bronze ⭐️⭐️⭐️
September 27, 2021
Solved

HBase tuning for computers with different hardware spec

Hi all,

I have a cluster of which computers are with different hardware spec.

Is there a way to make Region Server to hold different number of regions depending on the hardware spec of the host?

Or is there other way for performance tuning under this circumstance?

The hardware spec for HBase Region Server:

 CPU (cores)Memory (GB)Numbers
Computer 14321
Compurer 2864

2

Computer 324256

5

There are YARN and HBase on this cluster of 8 Computers.

smdas
smdasAnswer
Gold ⭐️⭐️
October 21, 2021

Hello @Malvin 

 

Thanks for using Cloudera Community. Based on the Post, You wish to have RegionServers to hold different number of Regions depending on the Hardware Spec of the Host. 

 

Note that RegionServer JVM runs with a Heap allocation, which is expected to be Uniform across the RegionServer(s). You may consider using RegionServer Grouping [1] to ensure Regions from Tables with Large Region Count are mapped to few RegionServers. The Link offers Implementation & Use-Cases details as well. 

 

Regards, Smarak

 

[1] https://hbase.apache.org/book.html#rsgroup

View in thread

2 replies

smdas
Gold ⭐️⭐️
smdasAnswer
Gold ⭐️⭐️
October 21, 2021

Hello @Malvin 

 

Thanks for using Cloudera Community. Based on the Post, You wish to have RegionServers to hold different number of Regions depending on the Hardware Spec of the Host. 

 

Note that RegionServer JVM runs with a Heap allocation, which is expected to be Uniform across the RegionServer(s). You may consider using RegionServer Grouping [1] to ensure Regions from Tables with Large Region Count are mapped to few RegionServers. The Link offers Implementation & Use-Cases details as well. 

 

Regards, Smarak

 

[1] https://hbase.apache.org/book.html#rsgroup

Translate
    smdas
    Gold ⭐️⭐️
    smdas
    Gold ⭐️⭐️
    October 23, 2021

    Hello @Malvin 

     

    We are marking the Post as Solved as Region Server Grouping is the Only Way to Segregate the Region Assignment at Region Server Level. If your Team encounter any issues, Feel free to Update the Post & we shall get back to your Team accordingly.

     

    Thank You again for using Cloudera Community.

     

    Regards, Smarak

    Translate
    Terms & ConditionsAccessibility statement