Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Plot average number of exceptions in ambari metrics

Highlighted

Plot average number of exceptions in ambari metrics

New Contributor

in

/var/log/hadoop/hdfs/hadoop-hdfs-namenode-HOST.log

I see exceptions like:

2018-03-10 11:41:49,566 INFO  ipc.Server (Server.java:doRead(1006)) - Socket Reader #1 for port 8020: readAndProcess from client CLIENT_HOST threw exception [java.io.IOException: Connection reset by peer]
java.io.IOException: Connection reset by peer
        at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
        at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
        at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
        at sun.nio.ch.IOUtil.read(IOUtil.java:197)
        at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:380)
        at org.apache.hadoop.ipc.Server.channelRead(Server.java:2930)
        at org.apache.hadoop.ipc.Server.access$3000(Server.java:138)
        at org.apache.hadoop.ipc.Server$Connection.readAndProcess(Server.java:1741)
        at org.apache.hadoop.ipc.Server$Listener.doRead(Server.java:995)
        at org.apache.hadoop.ipc.Server$Listener$Reader.doRunLoop(Server.java:852)
        at org.apache.hadoop.ipc.Server$Listener$Reader.run(Server.java:823)

Is there a way to plot the average number of execeptions in a time window?

Does it already exist?

1 REPLY 1

Re: Plot average number of exceptions in ambari metrics

Super Mentor

@Leonardo Apolonio

Unfortunately there is no out of the box metrics available which can plot the average number of exceptions in amabri metrics.

However you might want to see the Ambari Metrics Collector specification to know how it works and it allows users to create and register custom metrics as well.

https://cwiki.apache.org/confluence/display/AMBARI/Metrics+Collector+API+Specification