Archives of Support Questions (Read Only)

This is an archived board for historical reference. Information and links may no longer be available or relevant
Announcements
This board is archived and read-only for historical reference. To ask a new question, please post a new topic on the appropriate active board.

Unable to see HDFS metrics in Grafana

avatar
Rising Star

I am following this link : https://cwiki.apache.org/confluence/display/AMBARI/Enabling+HDFS+per-user+Metrics

However, I am still not able to view the metrics in Grafana.

Is there a different set of settings that we need to do for a HA environment?

1 ACCEPTED SOLUTION

avatar

The article you mentioned only talks about non-HA scenario.

For a HA scenario:

1. You must add one line per namenode.

For example if you have 2 namenodes nn1 and nn2 and dfs.internal.nameservices-nnha, then

dfs.namenode.servicerpc-address.<dfs.internal.nameservices>.nn1=<namenodehost1>:8021
dfs.namenode.servicerpc-address.<dfs.internal.nameservices>.nn2=<namenodehost2>:8021

2. Stop all ZKFC and then from any namenode host run the command:

hdfs zkfc -formatZK

3. Restart ZKFC and HDFS.

4. Now you will be able to see metrics in grafana after few minutes.

View solution in original post

1 REPLY 1

avatar

The article you mentioned only talks about non-HA scenario.

For a HA scenario:

1. You must add one line per namenode.

For example if you have 2 namenodes nn1 and nn2 and dfs.internal.nameservices-nnha, then

dfs.namenode.servicerpc-address.<dfs.internal.nameservices>.nn1=<namenodehost1>:8021
dfs.namenode.servicerpc-address.<dfs.internal.nameservices>.nn2=<namenodehost2>:8021

2. Stop all ZKFC and then from any namenode host run the command:

hdfs zkfc -formatZK

3. Restart ZKFC and HDFS.

4. Now you will be able to see metrics in grafana after few minutes.