question Re: Compatibility of HBase with HDFS - Erasure Coding (EC) in Support Questions

Compatibility of HBase with HDFS - Erasure Coding (EC)

bgkim — Tue, 21 Apr 2026 07:47:15 GMT

Some hdfs operations (hsync, append, ... ) are not supported with the erasure coding (ec) policy.

Does hbase work well when the data folders of hbase are set to the erasure coding policy?

Is Hbase compatible with HDFS-EC instead of HDFS-replica ?

Re: Compatibility of HBase with HDFS - Erasure Coding (EC)

rki_ — Thu, 24 Nov 2022 06:50:19 GMT

HI @bgkim, Hbase won't work well with data folders of hbase set to EC policy. EC did not implement hflush which is required to not lose data. Additionally, the Data locality is also killed with EC which makes it slower.

https://docs.cloudera.com/cdp-private-cloud-upgrade/latest/cdppvc-data-migration-opdb/topics/cdppvc-data-migration-hbase-unsupported-interfaces-features.html

--
Was your question answered? Please take some time to click on “Accept as Solution” below this post.
If you find a reply useful, say thanks by clicking on the thumbs up button.

Re: Compatibility of HBase with HDFS - Erasure Coding (EC)

nitishgoyal13 — Thu, 24 Aug 2023 05:57:17 GMT

Is anyone aware if there are any plans for hflush implementation in EC in future versions?