question Re: HBase & Phoenix Query Server Tuning properties. in Archives of Support Questions (Read Only)

HBase & Phoenix Query Server Tuning properties.

bandarusridhar1 — Mon, 03 Oct 2016 22:03:15 GMT

Hi,

I'm doing POC on HBase and Phoenix Query Server for next project. We would like to tune both the services for the best outcome for operations on 100million records. Right now we are using most of the default parameters which come with Hortonworks installation.

Can anyone provide the best set of tuning properties operations on 100million records?

Any help is highly appreciated and thanks in advance.

Re: HBase & Phoenix Query Server Tuning properties.

rchintaguntla — Tue, 04 Oct 2016 13:13:52 GMT

@SBandaru,

For HBase tuning you can refer following links:

http://www.slideshare.net/lhofhansl/h-base-tuninghbasecon2015ok

https://community.hortonworks.com/questions/1277/what-is-the-best-consolidated-guide-for-hbase-tuni.html

For Phoenix tuning following link helps:

http://phoenix.apache.org/tuning.html

Use http://phoenix.apache.org/update_statistics.html for more parallelization and better performance.

For more phoenix level optimizations You can refer Optimization sections in

http://www.slideshare.net/je2451/apache-phoenix-and-apache-hbase-an-enterprise-grade-data-warehouse

Re: HBase & Phoenix Query Server Tuning properties.

elserj — Wed, 05 Oct 2016 00:34:39 GMT

Some extra thoughts on top of Rajeshbabu's reply:

1. Increase the heapsize of the Phoenix Query Server via the PHOENIX_QUERYSERVER_OPTS variable hbase-env.sh

2. For writing data, make sure the addBatch() and executeBatch() API calls are used for the best performance