The change with vim zoo.cfg and restart zookeeper manually doesn't help as long as we restart zookeeper from ambari ... View more

Hi @Akhil S Naik Thank you for you reply, but when I modify via vim zoo.cfg, the config removed when I restart the Zookeeper service. configs.py or APIs cannot help as you see, they get only the parameters managed by Ambari. ... View more

Hi all, Thanks for help, the problem is solved by cleaning up the AMS data. but i am still not understand why this happening after upgarde. Regards ... View more

Hi I am not resolved to problem yet, here are the log of ambari-metrics et hbase-ams thanks ambari-metrics-collector log: -------------------------------- 2018-08-31 17:17:29,367 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection to server host102/x.x.x.x:61181. Will not attempt to authenticate using SASL (unknown error) 2018-08-31 17:17:29,367 WARN org.apache.zookeeper.ClientCnxn: Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1141) 2018-08-31 17:17:29,834 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection to server host102/x.x.x.x:61181. Will not attempt to authenticate using SASL (unknown error) 2018-08-31 17:17:29,834 WARN org.apache.zookeeper.ClientCnxn: Session 0x1659083ffc20001 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1141) 2018-08-31 17:17:29,991 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection to server host102/x.x.x.x:61181. Will not attempt to authenticate using SASL (unknown error) 2018-08-31 17:17:29,991 WARN org.apache.zookeeper.ClientCnxn: Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1141) 2018-08-31 17:17:30,091 WARN org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper: Possibly transient ZooKeeper, quorum=host102:61181, exception=org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /ams-hbase-secure/meta-region-server ################################################################### hbase-ams log -------------------------------------------------- 2018-08-31 17:08:13,773 INFO [main-SendThread(host102:61181)] zookeeper.ClientCnxn: Opening socket connection to server host102/x.x.x.x:61181. Will not attempt to authenticate using SASL (unknown error) 2018-08-31 17:08:13,773 WARN [main-SendThread(host102:61181)] zookeeper.ClientCnxn: Session 0x1659083ffc20002 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1125) 2018-08-31 17:08:14,944 INFO [RS:0;host102:50466-SendThread(host102:61181)] zookeeper.ClientCnxn: Opening socket connection to server host102/x.x.x.x:61181. Will not attempt to authenticate using SASL (unknown error) 2018-08-31 17:08:14,944 WARN [RS:0;host102:50466-SendThread(host102:61181)] zookeeper.ClientCnxn: Session 0x1659083ffc20004 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1125) 2018-08-31 17:08:15,536 INFO [main-SendThread(host102:61181)] zookeeper.ClientCnxn: Opening socket connection to server host102/x.x.x.x:61181. Will not attempt to authenticate using SASL (unknown error) 2018-08-31 17:08:15,536 WARN [main-SendThread(host102:61181)] zookeeper.ClientCnxn: Session 0x1659083ffc20002 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1125) 2018-08-31 17:08:16,228 ERROR [main] master.HMasterCommandLine: Master exiting java.lang.RuntimeException: Master not initialized after 200000ms seconds at org.apache.hadoop.hbase.util.JVMClusterUtil.startup(JVMClusterUtil.java:230) at org.apache.hadoop.hbase.LocalHBaseCluster.startup(LocalHBaseCluster.java:445) at org.apache.hadoop.hbase.master.HMasterCommandLine.startMaster(HMasterCommandLine.java:229) at org.apache.hadoop.hbase.master.HMasterCommandLine.run(HMasterCommandLine.java:139) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76) at org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:126) at org.apache.hadoop.hbase.master.HMaster.main(HMaster.java:2838) ... View more

Hi @Akhil S Naik Yes, i do all post upgrade tasks of ambari upgrade specialy for ambari-metrics, below the output [root@myhost ~]# rpm -qa |grep -i ambari ambari-agent-2.6.2.2-1.x86_64 ambari-metrics-collector-2.6.2.2-1.x86_64 ambari-metrics-hadoop-sink-2.6.2.2-1.x86_64 ambari-metrics-monitor-2.6.2.2-1.x86_64 ... View more