https://community.cloudera.com/t5/Archives-of-Support-Questions/ResourceManager-intermittently-fails-with-error/m-p/172696#M42121 <P>Hi Jyothi, please refer this link hope this will be helpful for you.</P><P><A href="http://stackoverflow.com/questions/17533661/zookeeper-error-connection-loss-exception" target="_blank">http://stackoverflow.com/questions/17533661/zookeeper-error-connection-loss-exception</A></P> Thu, 29 Sep 2016 13:42:42 GMT maheshmsh88 2016-09-29T13:42:42Z https://community.cloudera.com/t5/Archives-of-Support-Questions/ResourceManager-intermittently-fails-with-error/m-p/172695#M42120 <P>Hi,</P><P>Resource manager fails intermittently and following error message is displayed:</P><P>2016-09-28 16:42:20,466 INFO recovery.ZKRMStateStore (ZKRMStateStore.java:runWithRetries(1211)) - Exception while executing a ZK operation. org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /rmstore at org.apache.zookeeper.KeeperException.create(KeeperException.java:99) at org.apache.zookeeper.KeeperException.create(KeeperException.java:51) at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783) at org.apache.hadoop.yarn.server.resourcemanager.recovery.ZKRMStateStore$1.run(ZKRMStateStore.java:326) at org.apache.hadoop.yarn.server.resourcemanager.recovery.ZKRMStateStore$1.run(ZKRMStateStore.java:322) at org.apache.hadoop.yarn.server.resourcemanager.recovery.ZKRMStateStore$ZKAction.runWithCheck(ZKRMStateStore.java:1158) at org.apache.hadoop.yarn.server.resourcemanager.recovery.ZKRMStateStore$ZKAction.runWithRetries(ZKRMStateStore.java:1191) at org.apache.hadoop.yarn.server.resourcemanager.recovery.ZKRMStateStore.createRootDir(ZKRMStateStore.java:322) at org.apache.hadoop.yarn.server.resourcemanager.recovery.ZKRMStateStore.createRootDirRecursively(ZKRMStateStore.java:1295) at org.apache.hadoop.yarn.server.resourcemanager.recovery.ZKRMStateStore.startInternal(ZKRMStateStore.java:303) at org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore.serviceStart(RMStateStore.java:563) at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$RMActiveServices.serviceStart(ResourceManager.java:579) at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.startActiveServices(ResourceManager.java:956) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$1.run(ResourceManager.java:997) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$1.run(ResourceManager.java:993) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.transitionToActive(ResourceManager.java:993) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceStart(ResourceManager.java:1033) at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:1177) 2016-09-28 16:42:20,466 INFO recovery.ZKRMStateStore (ZKRMStateStore.java:runWithRetries(1214)) - Retrying operation on ZK. Retry no. 666 2016-09-28 16:42:20,466 INFO zookeeper.ClientCnxn (ClientCnxn.java:logStartConnect(1019)) - Opening socket connection to server VORA1.ad.company.com/10.78.1.240:2181. Will not attempt to authenticate using SASL (unknown error) 2016-09-28 16:42:20,467 WARN zookeeper.ClientCnxn (ClientCnxn.java:run(1146)) - Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1125)</P> Wed, 28 Sep 2016 18:20:53 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/ResourceManager-intermittently-fails-with-error/m-p/172695#M42120 jyoti_264 2016-09-28T18:20:53Z https://community.cloudera.com/t5/Archives-of-Support-Questions/ResourceManager-intermittently-fails-with-error/m-p/172696#M42121 <P>Hi Jyothi, please refer this link hope this will be helpful for you.</P><P><A href="http://stackoverflow.com/questions/17533661/zookeeper-error-connection-loss-exception" target="_blank">http://stackoverflow.com/questions/17533661/zookeeper-error-connection-loss-exception</A></P> Thu, 29 Sep 2016 13:42:42 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/ResourceManager-intermittently-fails-with-error/m-p/172696#M42121 maheshmsh88 2016-09-29T13:42:42Z https://community.cloudera.com/t5/Archives-of-Support-Questions/ResourceManager-intermittently-fails-with-error/m-p/172697#M42122 <P>Thanks it worked <span class="lia-unicode-emoji" title=":slightly_smiling_face:">🙂</span></P> Thu, 29 Sep 2016 21:44:54 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/ResourceManager-intermittently-fails-with-error/m-p/172697#M42122 jyoti_264 2016-09-29T21:44:54Z