question Re: Reduce Existing HBase Table Regions in Archives of Support Questions (Read Only)

Reduce Existing HBase Table Regions

bcobb — Tue, 07 Mar 2017 06:29:03 GMT

Hi - Looking for some better methods of reducing existing table region count. We have a few tables that were originally pre split with far too many regions. Time goes on and Issues like performance and compaction storms are evident. With smaller tables I've been using Export/Import or CopyTable to move the data to new tables with less regions, but larger tables (TBs) are very challenging to run to completion.

Are there any better strategies for accomplishing the above? In some cases the region counts are so high that manually merging them is not feasible so I find myself back at Export/Import.

Re: Reduce Existing HBase Table Regions

elserj — Tue, 07 Mar 2017 06:31:07 GMT

The HBase Region Normalizer sounds like it would be a good fit.

https://community.hortonworks.com/articles/54987/hbase-region-normalizer.html

https://hbase.apache.org/devapidocs/org/apache/hadoop/hbase/master/normalizer/SimpleRegionNormalizer.html

Re: Reduce Existing HBase Table Regions

bcobb — Tue, 07 Mar 2017 06:40:09 GMT

That looks really promising, thanks for the link!