question HBase cell size (files) in Archives of Support Questions (Read Only)

HBase cell size (files)

butkiz — Fri, 16 Sep 2022 10:39:54 GMT

Dear Colleagues

I want to store files up to 150 MB (10% of file set, other 90% of files are <10 MB) in HBase. Is ist possible or should i take another approach?

Thanks in advance and best regards,

Butkiz

Re: HBase cell size (files)

Harsh J — Wed, 05 Oct 2016 07:57:06 GMT

While it may appear possible to do this I'd strongly recommend against it because when you'd read back a written 150 MB MOB cell, it'd give you heap utilisation problems during the RPC encoding and transfer done by the RS.

Its probably better to store the larger-than-10 MB files as HDFS files and store their paths in HBase.