Customize Hbase JVM settings in CDH-5.4.2

[#1]

I am trying to enable tje JVM settings for monitoring of HBase performance. Initially I thought this would be a simple change, but I was wrong.

The documentation briefly mentions that the conf files for Hbase follow Hadoop conventions, but that is probably the case if CDH cluster is installed 

directly without the Cloudera manager.

Acorrding to the documentation http://archive.cloudera.com/cdh5/cdh/5/hbase/book.html#jmx_config

the hbase-env.sh file should be modified with these settings 

export HBASE_JMX_BASE="-Dcom.sun.management.jmxremote.authenticate=true                  \
                       -Dcom.sun.management.jmxremote.password.file=your_password_file   \
                       -Dcom.sun.management.jmxremote.access.file=your_access_file"

export HBASE_MASTER_OPTS="$HBASE_MASTER_OPTS $HBASE_JMX_BASE "
export HBASE_REGIONSERVER_OPTS="$HBASE_REGIONSERVER_OPTS $HBASE_JMX_BASE "

The question is which hbase-env.sh should be modified.  The problem is that the CDH agent is dynamically managing the configuration of Hbase,

and it seems not to use the /etc/hbase/conf file or 

/opt/cloudera/parcels/CDH-5.4.2-1.cdh5.4.2.p0.2/etc/hbase/conf.dist/hbase-env.sh

 From what I've seen the CDH client dynamically generates the config file for Supervisord, the process managing Hbase servers, and also the property files

under /var/run/cloudera-scm-agent/process/ directory.  Supervisord sets the environment and invokse the Hbase start-up script. 

The question is how to overide the settings that normally would go into hbase-env.sh?

I am using CHD 5.4.2 on CentOS 6.6 x86_64, and jdk1.7.0_67

Thanks

Dimitar

[#2]

You can pass those env settings via safety valve. From Cloudera Manager UI, go to hbase configuration page, and find property 'HBase Service Environment Advanced Configuration Snippet (Safety Valve)', add key-value pairs there, save the value, and restart the service.

The settings will impact all roles of the service except client configuration.

[#3 · Accepted solution]

It worked, thanks!

For the benefits of the others not familiar with the security valve role,

the following env settings were added under Advanced > HBase Service Environment Advanced Configuration Snippet (Safety Valve)

HBASE_MASTER_OPTS=-Dcom.sun.management.jmxremote.ssl=false -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.port=10101
HBASE_REGIONSERVER_OPTS=-Dcom.sun.management.jmxremote.ssl=false -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.port=10102

 The usual shell variable substitution is not working in this scenario. Each env variable needs to be explicitly defined. 

[#4]

Hi Experts

I was trying to do simlilar change i.e. change Java option manually, however my problem is bit different.  I need to reduce value of parameter "Java Heap Size of HBase RegionServer in Bytes"  - only on 1 region server because this host has less memory allocated compare to others.  I want this parameter to be in effect  only for one host but region server role consistes of 3 hosts

Thanks in advance