Support Questions

Find answers, ask questions, and share your expertise

Ambari Metrics per user metrics dfs.namenode.servicerpc-address config for HA Namenode


I am trying to use Grafana's HDFS Users dashboard and to set Ambari Metrics to collect user information, I followed the instructions in this page

One of the config is "dfs.namenode.servicerpc-address" and it requires specifying a namenode host. This does not work on an HA cluster where you have two namenodes.

Any recommendations on how to configure this property?

Currently it breaks the namenodes and I had to remove it.


Super Mentor

@Theyaa Matti

Please try these steps: 1). In Ambari, HDFS > Configs > Advanced > Custom hdfs-site, Add the following properties. Herer "My-NN-HA" is the Cluster Service name

2). After the mentoined changes you might get the following error in your Logs while starting the servivce. Also the NameNodes might be moved to "StandBy" (Both)

2017-06-20 06:38:14,116 WARN  ha.EditLogTailer ( - Unable to trigger a roll of the active NN
org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category JOURNAL is not supported in state standby
        at org.apache.hadoop.hdfs.server.namenode.ha.StandbyState.checkOperation(
        at org.apache.hadoop.hdfs.server.namenode.NameNode$NameNodeHAContext.checkOperation(


java.lang.RuntimeException: Mismatched address stored in ZK for NameNode

3). So you will need to run the following command. Stop the ZKFC processes on both NameNodes to reset the ZKFC state in ZooKeeper

hdfs zkfc -formatZK

4). Restart the ZKFC servers and then check the grafana / AMS after 2-3 minutes time..



Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.