Support Questions

Find answers, ask questions, and share your expertise

HBase cell size (files)

avatar
Contributor

Dear Colleagues

 

I want to store files up to 150 MB (10% of file set, other 90% of files are <10 MB)  in HBase. Is ist possible or should i take another approach?

 

Thanks in advance and best regards,

 Butkiz

 

 

1 ACCEPTED SOLUTION

avatar
Mentor
While it may appear possible to do this I'd strongly recommend against it because when you'd read back a written 150 MB MOB cell, it'd give you heap utilisation problems during the RPC encoding and transfer done by the RS.

Its probably better to store the larger-than-10 MB files as HDFS files and store their paths in HBase.

View solution in original post

1 REPLY 1

avatar
Mentor
While it may appear possible to do this I'd strongly recommend against it because when you'd read back a written 150 MB MOB cell, it'd give you heap utilisation problems during the RPC encoding and transfer done by the RS.

Its probably better to store the larger-than-10 MB files as HDFS files and store their paths in HBase.