Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

HBase cell size (files)

Solved Go to solution
Highlighted

HBase cell size (files)

Contributor

Dear Colleagues

 

I want to store files up to 150 MB (10% of file set, other 90% of files are <10 MB)  in HBase. Is ist possible or should i take another approach?

 

Thanks in advance and best regards,

 Butkiz

 

 

1 ACCEPTED SOLUTION

Accepted Solutions

Re: HBase cell size (files)

Master Guru
While it may appear possible to do this I'd strongly recommend against it because when you'd read back a written 150 MB MOB cell, it'd give you heap utilisation problems during the RPC encoding and transfer done by the RS.

Its probably better to store the larger-than-10 MB files as HDFS files and store their paths in HBase.
1 REPLY 1

Re: HBase cell size (files)

Master Guru
While it may appear possible to do this I'd strongly recommend against it because when you'd read back a written 150 MB MOB cell, it'd give you heap utilisation problems during the RPC encoding and transfer done by the RS.

Its probably better to store the larger-than-10 MB files as HDFS files and store their paths in HBase.
Don't have an account?
Coming from Hortonworks? Activate your account here