Support Questions

Find answers, ask questions, and share your expertise

Unable to see HDFS metrics in Grafana

avatar
Rising Star

I am following this link : https://cwiki.apache.org/confluence/display/AMBARI/Enabling+HDFS+per-user+Metrics

However, I am still not able to view the metrics in Grafana.

Is there a different set of settings that we need to do for a HA environment?

1 ACCEPTED SOLUTION

avatar

The article you mentioned only talks about non-HA scenario.

For a HA scenario:

1. You must add one line per namenode.

For example if you have 2 namenodes nn1 and nn2 and dfs.internal.nameservices-nnha, then

dfs.namenode.servicerpc-address.<dfs.internal.nameservices>.nn1=<namenodehost1>:8021
dfs.namenode.servicerpc-address.<dfs.internal.nameservices>.nn2=<namenodehost2>:8021

2. Stop all ZKFC and then from any namenode host run the command:

hdfs zkfc -formatZK

3. Restart ZKFC and HDFS.

4. Now you will be able to see metrics in grafana after few minutes.

View solution in original post

1 REPLY 1

avatar

The article you mentioned only talks about non-HA scenario.

For a HA scenario:

1. You must add one line per namenode.

For example if you have 2 namenodes nn1 and nn2 and dfs.internal.nameservices-nnha, then

dfs.namenode.servicerpc-address.<dfs.internal.nameservices>.nn1=<namenodehost1>:8021
dfs.namenode.servicerpc-address.<dfs.internal.nameservices>.nn2=<namenodehost2>:8021

2. Stop all ZKFC and then from any namenode host run the command:

hdfs zkfc -formatZK

3. Restart ZKFC and HDFS.

4. Now you will be able to see metrics in grafana after few minutes.