Member since
11-23-2022
3
Posts
0
Kudos Received
0
Solutions
07-20-2023
10:58 PM
Hello, I've heared that Hbase is not officially compatibile with HDFS-EC( Erasure Coding policy) due to the performance limitation and unsupported operations of hdfs (e.g, hflush or hsync). Can any errors or problems arise if I use HBase for read-only workloads? For example, I directly make hfiles from raw data (using Spark) and bulk load the hfiles to HBase, and HBase clients only invoke read (get) requests. (Also, there is no hbase compaction) In the above scenario, I think hbase can be work with HDFS-EC due to the following reasons. 1. Since data are written in bulk, the above unsupported operations do not matter. 2. In my experiance, thought HDFS-EC's write performance is about 3 times slower than the HDFS-REP (3 copy), the HDFS-EC's read performance is almost the same as the HDFS-REP. Therefore performance limitation seems not matter. I want some advice for the possibility of this hbase+hdfs-ec architecture in this scenario.
... View more
Labels:
02-16-2023
08:03 PM
Hello, I have a question about the performance of the local index in Apache Phoenix For example, I have a table TBL_X having 6 columns (A , B ,C ,D E, F). 1. Primary Key is (A, B) 2. One of the query patterns is "Select * from TBL_X where A = 'val1' and C = 'val3' " For the better performance of the above query, I try to build the local index. Does [ Local index on (C, A) ] perform better than [ Local index on (C) ] ?? or Will there be no performance difference since A is already in the first part of the PK ??
... View more
Labels:
- Labels:
-
Apache HBase
-
Apache Phoenix
11-23-2022
06:15 PM
Some hdfs operations (hsync, append, ... ) are not supported with the erasure coding (ec) policy. Does hbase work well when the data folders of hbase are set to the erasure coding policy? Is Hbase compatible with HDFS-EC instead of HDFS-replica ?
... View more