Testing HBase bucket cache

[#1]

I am testing bucket cache implementation on my dev cluster (2 node) before implementing on the production cluster. On the dev, i have 32GB RAM and i have tried to configure bucket cache with the free memory but it always bring down the region server with OOM error. I need a configuration specification to test before i slam it on the production cluster (production cluster has excess of 100GB RAM). Find attached the hortonworks template i used and the error log.

[#2]

can you please also attach hbase-site.xml and hbase-env.sh

[#3]

Please find attached the hbase-site.xml and hbase-env.sh files. Thank you @Ankit Singhal.

[#4 · Accepted solution]

As per your hbase-site.xml, bucket cache size is configured as

<property>
      <name>hbase.bucketcache.size</name>
      <value>6416</value>
    </property

But hbase-env.sh has MaxDirectMemorySize is set to just  

-XX:MaxDirectMemorySize=6128

You need to set this -XX:MaxDirectMemorySize in hbase-env.sh to more than the bucket cache size configuration, and remember to suffix the configuration with "m"

-XX:MaxDirectMemorySize=6528m

[#5]

Thank you @Ankit Singhal. The implementation worked as advised.

[#6]

Which release of HDP are you using ?

[#7]

Release 2.4.2