Created on 09-26-2021 08:40 PM - edited 09-26-2021 08:49 PM
Hi all,
I have a cluster of which computers are with different hardware spec.
Is there a way to make Region Server to hold different number of regions depending on the hardware spec of the host?
Or is there other way for performance tuning under this circumstance?
The hardware spec for HBase Region Server:
CPU (cores) | Memory (GB) | Numbers | |
Computer 1 | 4 | 32 | 1 |
Compurer 2 | 8 | 64 | 2 |
Computer 3 | 24 | 256 | 5 |
There are YARN and HBase on this cluster of 8 Computers.
Created 10-21-2021 12:22 AM
Hello @Malvin
Thanks for using Cloudera Community. Based on the Post, You wish to have RegionServers to hold different number of Regions depending on the Hardware Spec of the Host.
Note that RegionServer JVM runs with a Heap allocation, which is expected to be Uniform across the RegionServer(s). You may consider using RegionServer Grouping [1] to ensure Regions from Tables with Large Region Count are mapped to few RegionServers. The Link offers Implementation & Use-Cases details as well.
Regards, Smarak
Created 10-21-2021 12:22 AM
Hello @Malvin
Thanks for using Cloudera Community. Based on the Post, You wish to have RegionServers to hold different number of Regions depending on the Hardware Spec of the Host.
Note that RegionServer JVM runs with a Heap allocation, which is expected to be Uniform across the RegionServer(s). You may consider using RegionServer Grouping [1] to ensure Regions from Tables with Large Region Count are mapped to few RegionServers. The Link offers Implementation & Use-Cases details as well.
Regards, Smarak
Created 10-23-2021 08:09 AM
Hello @Malvin
We are marking the Post as Solved as Region Server Grouping is the Only Way to Segregate the Region Assignment at Region Server Level. If your Team encounter any issues, Feel free to Update the Post & we shall get back to your Team accordingly.
Thank You again for using Cloudera Community.
Regards, Smarak