Archives of Support Questions (Read Only)

This is an archived board for historical reference. Information and links may no longer be available or relevant
Announcements
This board is archived and read-only for historical reference. To ask a new question, please post a new topic on the appropriate active board.

HBase cell size (files)

avatar
Contributor

Dear Colleagues

 

I want to store files up to 150 MB (10% of file set, other 90% of files are <10 MB)  in HBase. Is ist possible or should i take another approach?

 

Thanks in advance and best regards,

 Butkiz

 

 

1 ACCEPTED SOLUTION

avatar
Mentor
While it may appear possible to do this I'd strongly recommend against it because when you'd read back a written 150 MB MOB cell, it'd give you heap utilisation problems during the RPC encoding and transfer done by the RS.

Its probably better to store the larger-than-10 MB files as HDFS files and store their paths in HBase.

View solution in original post

1 REPLY 1

avatar
Mentor
While it may appear possible to do this I'd strongly recommend against it because when you'd read back a written 150 MB MOB cell, it'd give you heap utilisation problems during the RPC encoding and transfer done by the RS.

Its probably better to store the larger-than-10 MB files as HDFS files and store their paths in HBase.