Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]

Archives of Support Questions (Read Only)

This is an archived board for historical reference. Information and links may no longer be available or relevant
Announcements
This board is archived and read-only for historical reference. To ask a new question, please post a new topic on the appropriate active board.

How regionserver in hbase will read huge hfiles?

avatar
Rising Star

Let say i have a region with region max store file size 10 GB and after major compaction i have a single hfile with size 9GB(stored in hadoop). Now my doubt is how regionserver will read and process that 9GB file from hadoop.

Will it initially load that file to regionserver inmemory? if yes how it is possible if my heap size is only 8GB?

1 ACCEPTED SOLUTION

avatar
Super Guru

HBase does not have to read an entire HFile into memory to service reads.

View solution in original post

2 REPLIES 2

avatar
Super Guru

HBase does not have to read an entire HFile into memory to service reads.

avatar
Rising Star

@Josh Elser

Tnx dude for your reply, can you please explain me how query matcher in hbase work or else if you have a good link regarding query matcher please share with me, it will helpful for me to understand.

Thank you