@SBandaru, For HBase tuning you can refer following links: http://www.slideshare.net/lhofhansl/h-base-tuninghbasecon2015ok https://community.hortonworks.com/questions/1277/what-is-the-best-consolidated-guide-for-hbase-tuni.html For Phoenix tuning following link helps: http://phoenix.apache.org/tuning.html Use http://phoenix.apache.org/update_statistics.html for more parallelization and better performance. For more phoenix level optimizations You can refer Optimization sections in http://www.slideshare.net/je2451/apache-phoenix-and-apache-hbase-an-enterprise-grade-data-warehouse ... View more

@Ramy Mansour You can directly create table in phoenix and load data using CsvBulkLoadTool. http://phoenix.apache.org/bulk_dataload.html#Loading_via_MapReduce Currently with your data there will be 1000's of mappers running. The number of reducers depending on the number regions so increase the parallelization you can presplit the table by providing split points in DDL statement. You can also compress the table to reduce IO or shuffle data during bulkload tool. http://phoenix.apache.org/language/index.html#create_table Or else you can directly use ImportTsv and completeBulkload bulkload tools for loading data into HBase table directly. https://hbase.apache.org/book.html#importtsv https://hbase.apache.org/book.html#completebulkload Here some more configurations can be provided to mapred-site.xml to improve the job performance. <property> <name>mapreduce.map.output.compress</name> <value>true</value> </property> <property> <name>mapred.map.output.compress.codec</name> <value>org.apache.hadoop.io.compress.SnappyCodec</value> </property> ... View more

You can get more info here: https://cwiki.apache.org/confluence/display/Hive/HBaseIntegration http://hortonworks.com/blog/hbase-via-hive-part-1/ ... View more

Here you get the more details: https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.0/bk_Sys_Admin_Guides/content/ch_clust_capacity.html ... View more

@Dheeraj Madan After altering the table you can run major compaction on the table from hbase shell so that existing data will be automatically compressed. > major_compact 'SNAPPY_TABLE' ... View more

Got the logs from @nshetty and checked somehow the hbase:acl table is not created because earlier hbase:acl znode is present but the table is not present. Once after deleting the hbase:acl table znode and restarting the service it's working fine. ... View more

It seems that PDI is not supporting Apache Phoenix yet. While loading data PDI generating insert queries but Phoenix needs upsert queries. http://jira.pentaho.com/browse/PDI-14038 https://mail-archives.apache.org/mod_mbox/phoenix-user/201509.mbox/%3CCAB3fahz1wacofQHDTyMMO-W_nCQ0gAcL0LpXdeMmZMxVXwwWOg@mail.gmail.com%3E It would be better to contact Pentaho PDI community. ... View more