Support Questions
Find answers, ask questions, and share your expertise

Plot average number of exceptions in ambari metrics

Explorer

in

/var/log/hadoop/hdfs/hadoop-hdfs-namenode-HOST.log

I see exceptions like:

2018-03-10 11:41:49,566 INFO  ipc.Server (Server.java:doRead(1006)) - Socket Reader #1 for port 8020: readAndProcess from client CLIENT_HOST threw exception [java.io.IOException: Connection reset by peer]
java.io.IOException: Connection reset by peer
        at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
        at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
        at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
        at sun.nio.ch.IOUtil.read(IOUtil.java:197)
        at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:380)
        at org.apache.hadoop.ipc.Server.channelRead(Server.java:2930)
        at org.apache.hadoop.ipc.Server.access$3000(Server.java:138)
        at org.apache.hadoop.ipc.Server$Connection.readAndProcess(Server.java:1741)
        at org.apache.hadoop.ipc.Server$Listener.doRead(Server.java:995)
        at org.apache.hadoop.ipc.Server$Listener$Reader.doRunLoop(Server.java:852)
        at org.apache.hadoop.ipc.Server$Listener$Reader.run(Server.java:823)

Is there a way to plot the average number of execeptions in a time window?

Does it already exist?

1 REPLY 1

Super Mentor

@Leonardo Apolonio

Unfortunately there is no out of the box metrics available which can plot the average number of exceptions in amabri metrics.

However you might want to see the Ambari Metrics Collector specification to know how it works and it allows users to create and register custom metrics as well.

https://cwiki.apache.org/confluence/display/AMBARI/Metrics+Collector+API+Specification

Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.