question Re: Enable HBase metrics for JMX in Archives of Support Questions (Read Only)

Enable HBase metrics for JMX

anthony_schuhl — Wed, 08 Mar 2017 06:25:33 GMT

I am trying to enable HBase metrics out to the JMX following this: https://hbase.apache.org/metrics.html. At the stage "Enable HBase stats collection", I am to edit $HBASE_HOME/conf/hadoop-metrics.properties on just the master servers or all the region servers as well? same goes for the Setup JMX remote access. Am I to create them on just my masters or on all regions?

I appreciate any help!

Re: Enable HBase metrics for JMX

namaheshwari — Wed, 08 Mar 2017 15:43:27 GMT

@Anthony Schuhl

What is the version of Hbase you are using. The Metrics system was redone in HBase 0.96 and there you might be required to edit the conf/hadoop-metrics2-hbase.properties file, as per:

http://mstanleyjones.github.io/hbase/reflow_update/book.html#_hbase_metrics

Also are you using Ambari? If yes then you don't need to modify config files on the hosts. Just select Hbase service, go to the Configs tab and add the properties over there. Once the property changes are done Ambari will ask to restart required services.
If you are not using Ambari, I think you would need to update the property files on different hosts and restart services as required.

Re: Enable HBase metrics for JMX

bcsergo — Wed, 08 Mar 2017 22:50:44 GMT

Add the following to your "Advanced hbase-env" part of Hbase config in Ambari.

If you're using ambari:

export HBASE_MASTER_OPTS="$HBASE_MASTER_OPTS -Dcom.sun.management.jmxremote.local.only=true -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.ssl=false -Dcom.sun.management.jmxremote.port=20015"
export HBASE_REGIONSERVER_OPTS="$HBASE_REGIONSERVER_OPTS -Dcom.sun.management.jmxremote.local.only=true -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.ssl=false -Dcom.sun.management.jmxremote.port=20016"

If you're not using Ambari add this manually to your hbase-env

Re: Enable HBase metrics for JMX

anthony_schuhl — Thu, 09 Mar 2017 01:25:18 GMT

So I attached a link to be more clear on what I was following, and I am currently using .98. So I want to setup the JMX for remote access, I do not see an ability to use Ambari to put those files on the server and I also do not see the ability to edit the metrics file on Ambari either.

Re: Enable HBase metrics for JMX

namaheshwari — Thu, 09 Mar 2017 03:03:56 GMT

Hi @Anthony Schuhl

For your case, please try to follow the below steps mentioned to enable HBase Metrics:

Re: Enable HBase metrics for JMX

anthony_schuhl — Thu, 09 Mar 2017 03:09:59 GMT

Hmm I don't think I need to enable all of those metrics to achieve what I am trying to do. I am just trying to get remote access for the metrics as detailed here: https://hbase.apache.org/metrics.html

Re: Enable HBase metrics for JMX

anthony_schuhl — Thu, 09 Mar 2017 03:11:18 GMT

Thank you for your response. So if you see here: https://hbase.apache.org/metrics.html I also want to enable the metrics for remote access. Do you know if i need to create the access files on each server?

Re: Enable HBase metrics for JMX

namaheshwari — Thu, 09 Mar 2017 03:19:06 GMT

To just configure metrics for a given region server, edit the conf/hadoop-metrics2-hbase.properties file and restart the region server for the changes to take effect. If you want to monitor the JMX metrics for each region server you would need to follow the similar steps on all hosts.

Re: Enable HBase metrics for JMX

anthony_schuhl — Thu, 09 Mar 2017 03:31:42 GMT

Where do you edit the conf/hadoop-metrics2-hbase.properties file on Ambari?

Re: Enable HBase metrics for JMX

namaheshwari — Thu, 09 Mar 2017 03:38:24 GMT

This will be a manual process, you would need to do it on the Region server host.

Re: Enable HBase metrics for JMX

anthony_schuhl — Thu, 09 Mar 2017 04:47:52 GMT

(Sorry I can't seem to reply on a later message as I guess we are too far down the thread chain) So I would need to edit the conf/hadoop-metrics2-hbase.properties on each region server? And I dont need to on the hbase masters? Is this the same for adding the remote access files? Thanks for your help!

Re: Enable HBase metrics for JMX

namaheshwari — Thu, 09 Mar 2017 05:31:23 GMT

Even I can't seem to reply now in that chain.

So, I think that you will need to modify the $HBASE_HOME/conf/hadoop-metrics2-hbase.properties file on all the Region servers and the HBase Masters. And restart each of those services. Also, for the remote access JMX files, again you would need to add that on all the hosts where you want to do the monitoring and add reference to the JMX files in $HBASE_HOME/conf/hbase-env.sh files.

This might be a tedious process doing it on all the hosts, so you might want to use the links in the previous answer for doing it via Ambari Or else give this is a try if the number of servers are few.

Hope this helps.

Re: Enable HBase metrics for JMX

anthony_schuhl — Fri, 10 Mar 2017 00:11:07 GMT

Thank you very much for your help on the matter! So I am not too worried about putting them on all of the servers as I can just do it with Ansible. But I guess I was confused by your links, they seem to be for another use case and enable much more metrics which all i wanted was another application (AppDynamics) to be able to access the JMX.