Options
- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Solved
Go to solution
HBase cell size (files)
Labels:
- Labels:
-
Apache HBase
Contributor
Created on ‎09-18-2016 01:03 AM - edited ‎09-16-2022 03:39 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Dear Colleagues
I want to store files up to 150 MB (10% of file set, other 90% of files are <10 MB) in HBase. Is ist possible or should i take another approach?
Thanks in advance and best regards,
Butkiz
1 ACCEPTED SOLUTION
Mentor
Created ‎10-05-2016 12:57 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
While it may appear possible to do this I'd strongly recommend against it because when you'd read back a written 150 MB MOB cell, it'd give you heap utilisation problems during the RPC encoding and transfer done by the RS.
Its probably better to store the larger-than-10 MB files as HDFS files and store their paths in HBase.
Its probably better to store the larger-than-10 MB files as HDFS files and store their paths in HBase.
1 REPLY 1
Mentor
Created ‎10-05-2016 12:57 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
While it may appear possible to do this I'd strongly recommend against it because when you'd read back a written 150 MB MOB cell, it'd give you heap utilisation problems during the RPC encoding and transfer done by the RS.
Its probably better to store the larger-than-10 MB files as HDFS files and store their paths in HBase.
Its probably better to store the larger-than-10 MB files as HDFS files and store their paths in HBase.
