- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Unable to see HDFS metrics in Grafana
- Labels:
-
Apache Hadoop
Created 10-27-2017 03:52 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I am following this link : https://cwiki.apache.org/confluence/display/AMBARI/Enabling+HDFS+per-user+Metrics
However, I am still not able to view the metrics in Grafana.
Is there a different set of settings that we need to do for a HA environment?
Created 10-27-2017 03:58 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
The article you mentioned only talks about non-HA scenario.
For a HA scenario:
1. You must add one line per namenode.
For example if you have 2 namenodes nn1 and nn2 and dfs.internal.nameservices-nnha, then
dfs.namenode.servicerpc-address.<dfs.internal.nameservices>.nn1=<namenodehost1>:8021 dfs.namenode.servicerpc-address.<dfs.internal.nameservices>.nn2=<namenodehost2>:8021
2. Stop all ZKFC and then from any namenode host run the command:
hdfs zkfc -formatZK
3. Restart ZKFC and HDFS.
4. Now you will be able to see metrics in grafana after few minutes.
Created 10-27-2017 03:58 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
The article you mentioned only talks about non-HA scenario.
For a HA scenario:
1. You must add one line per namenode.
For example if you have 2 namenodes nn1 and nn2 and dfs.internal.nameservices-nnha, then
dfs.namenode.servicerpc-address.<dfs.internal.nameservices>.nn1=<namenodehost1>:8021 dfs.namenode.servicerpc-address.<dfs.internal.nameservices>.nn2=<namenodehost2>:8021
2. Stop all ZKFC and then from any namenode host run the command:
hdfs zkfc -formatZK
3. Restart ZKFC and HDFS.
4. Now you will be able to see metrics in grafana after few minutes.
