Member since
04-25-2017
3
Posts
0
Kudos Received
0
Solutions
04-26-2017
07:22 AM
Hi thanks for your reply but I guess You missed my inital asked question. I got my information from here: http://hbase.apache.org/book.html#arch.regions.size In general, HBase is designed to run with a small (20-200) number of relatively large (5-20Gb) regions per server. The considerations for this are as follows:
So our assumption is to have 100 regions/RS (to not be on the limit) with 20GB region size. this results into having 100*20=2000GB available for each RS. I assume that this is the maximum amount of data a RS can handle in a performant way. Do you agree?
As this limit is very low, with respect to the amount of disk space we have available on our server, we want to install further RS on the same machine, in order to overcome this limit and use more of our disk space.
... View more
04-25-2017
02:16 PM
My goal is to have multiple regionserver service running on one bare metal host. My Server have 2x Xeon 2,4Ghz+ , 128 GB RAM and 40 TB HDD Space available which i want to adress to the RS. According to my knowledge one regionserver can handle only around 2,5 TB under normal circumstances: Lets assume followong config parameters: Java Heap Size = 16GB for each RS
Memstore Upper Limit = .5 = 8 GB Flush size at 128 MB This means that my Region Server can actively hold 16 GB / 128 MB = 128 regions
Now, let's say we take a 20 GB region size (128 regions * 20 GB = 2560 GB )
Does anyone have an idea how i can achive this? Thanks in advance
... View more
Labels:
04-25-2017
02:16 PM
My goal is to have multiple regionserver service running on one bare metal host. My Server have 2x Xeon 2,4Ghz+ , 128 GB RAM and 40 TB HDD Space available which i want to adress to the RS. According to my knowledge one regionserver can handle only around 2,5 TB under normal circumstances: Lets assume followong config parameters: Java Heap
Size = 16GB for each RS Memstore
Upper Limit = .5 = 8 GB Flush size
at 128 MB This means
that my Region Server can actively hold 16 GB / 128 MB = 128 regions Now, let's
say we take a 20 GB region size (128 regions * 20 GB = 2560 GB ) Does anyone have an idea how i can achive this? Thanks in advance
... View more
Labels: