Support Questions

Find answers, ask questions, and share your expertise

HBase cell size (files)

Contributor

Dear Colleagues

 

I want to store files up to 150 MB (10% of file set, other 90% of files are <10 MB)  in HBase. Is ist possible or should i take another approach?

 

Thanks in advance and best regards,

 Butkiz

 

 

1 ACCEPTED SOLUTION

Master Guru
While it may appear possible to do this I'd strongly recommend against it because when you'd read back a written 150 MB MOB cell, it'd give you heap utilisation problems during the RPC encoding and transfer done by the RS.

Its probably better to store the larger-than-10 MB files as HDFS files and store their paths in HBase.

View solution in original post

1 REPLY 1

Master Guru
While it may appear possible to do this I'd strongly recommend against it because when you'd read back a written 150 MB MOB cell, it'd give you heap utilisation problems during the RPC encoding and transfer done by the RS.

Its probably better to store the larger-than-10 MB files as HDFS files and store their paths in HBase.
Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.