Alerts for ZooKeeper Server

[#1]

hi all

from ambari we got the following alert

how we can identify the reason from this alert ?

Alerts for ZooKeeper Server

• ZooKeeper Server Process Connection failed: [Errno 104] Connection reset by peer to master01.sys65.com:2181

[#2 · Accepted solution]

@Michael Bronson

This is basically a Port check alert

https://github.com/apache/ambari/blob/release-2.6.2/ambari-server/src/main/resources/common-services...

So if you see that message means somehow the zookeeper Host & port was not accessibkle when you noticed that alert.

# telnet master01.sys65.com 2181 

.

Please check the access of the host and port from the host where the alert execution got failed.

Also please check the Zookeeper logs of the same time when the alert was triggered to see if there was any error Or if the Zookeeper was down during that time?

.

In ambari UI please check the alert time stamp to know when exactly it was triggered. If the time stamp is bit old then may be you can try Disabling that alert for 10-15 seconds and then enable it back to see if you are noticing any new instance/occurance of that alert.

[#3]

hi Jay , I see another problem

as you can see we get connecting and not connected

/usr/hdp/2.6.0.3-8/zookeeper/bin/zkCli.sh
Connecting to localhost:2181
Welcome to ZooKeeper!
JLine support is enabled
[zk: localhost:2181(CONNECTING) 0]

[#4]

[zk: localhost:2181(CONNECTING) 0] ls /
Exception in thread "main" org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /
        at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
        at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
        at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
        at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1500)
        at org.apache.zookeeper.ZooKeeperMain.processZKCmd(ZooKeeperMain.java:723)
        at org.apache.zookeeper.ZooKeeperMain.processCmd(ZooKeeperMain.java:591)
        at org.apache.zookeeper.ZooKeeperMain.executeLine(ZooKeeperMain.java:363)
        at org.apache.zookeeper.ZooKeeperMain.run(ZooKeeperMain.java:323)
        at org.apache.zookeeper.ZooKeeperMain.main(ZooKeeperMain.java:282)
You have mail in /var/spool/mail/root
[root@master01 ~]#