Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]
Created on 09-26-2021 08:40 PM - edited 09-26-2021 08:49 PM
Hi all,
I have a cluster of which computers are with different hardware spec.
Is there a way to make Region Server to hold different number of regions depending on the hardware spec of the host?
Or is there other way for performance tuning under this circumstance?
The hardware spec for HBase Region Server:
| CPU (cores) | Memory (GB) | Numbers | |
| Computer 1 | 4 | 32 | 1 |
| Compurer 2 | 8 | 64 | 2 |
| Computer 3 | 24 | 256 | 5 |
There are YARN and HBase on this cluster of 8 Computers.
Created 10-21-2021 12:22 AM
Hello @Malvin
Thanks for using Cloudera Community. Based on the Post, You wish to have RegionServers to hold different number of Regions depending on the Hardware Spec of the Host.
Note that RegionServer JVM runs with a Heap allocation, which is expected to be Uniform across the RegionServer(s). You may consider using RegionServer Grouping [1] to ensure Regions from Tables with Large Region Count are mapped to few RegionServers. The Link offers Implementation & Use-Cases details as well.
Regards, Smarak
Created 10-21-2021 12:22 AM
Hello @Malvin
Thanks for using Cloudera Community. Based on the Post, You wish to have RegionServers to hold different number of Regions depending on the Hardware Spec of the Host.
Note that RegionServer JVM runs with a Heap allocation, which is expected to be Uniform across the RegionServer(s). You may consider using RegionServer Grouping [1] to ensure Regions from Tables with Large Region Count are mapped to few RegionServers. The Link offers Implementation & Use-Cases details as well.
Regards, Smarak
Created 10-23-2021 08:09 AM
Hello @Malvin
We are marking the Post as Solved as Region Server Grouping is the Only Way to Segregate the Region Assignment at Region Server Level. If your Team encounter any issues, Feel free to Update the Post & we shall get back to your Team accordingly.
Thank You again for using Cloudera Community.
Regards, Smarak