Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

zookeeper error Unexpected exception causing shutdown while sock still open java.io.IOException

avatar

12:11:36.850 AM     WARN     org.apache.zookeeper.server.quorum.LearnerHandler     

******* GOODBYE /X.Y.Z.a:35337 ********

12:11:36.953 AM     ERROR     org.apache.zookeeper.server.quorum.LearnerHandler     

Unexpected exception causing shutdown while sock still open
java.io.IOException: Unreasonable length = 1970218037

 

     at org.apache.jute.BinaryInputArchive.readBuffer(BinaryInputArchive.java:95)
    at org.apache.zookeeper.server.quorum.QuorumPacket.deserialize(QuorumPacket.java:85)
    at org.apache.jute.BinaryInputArchive.readRecord(BinaryInputArchive.java:103)
    at org.apache.zookeeper.server.quorum.LearnerHandler.run(LearnerHandler.java:249)

 

Zookeeper server went down in HA cluster. Please replay if there is any work around.

5 REPLIES 5

avatar
Mentor
You can attempt to increase your jute.maxbuffer Java System Property on the ZK servers to a value higher than 2-3 GB (in bytes) to overcome this. It appears a very large record was somehow placed into your ZK by an application, which appears to have then caused this issue.

avatar

Hi Harsh

We are using CM5.3.3 and CDH5.3.3, For the latest CM and CDH(5.4.x) onwards I can see the configuration. could you please let us know the similar configuration for the CM and CDH version 5.3.3

 

Thank you.

avatar
Mentor
You can add a Java System Property setting that key, into the "Java Configuration Options for Zookeeper Server" field under ZooKeeper -> Configuration page.

Add in the -D format, for ex. for 4 GiB, append:

-Djute.maxbuffer=4294967296

avatar

Hi Harsh,

We have plan to upgrade the current cluster to 5.4.5. I've to discuss with the team to implement the suggested configuration change. Thank you for the suestion.

 

Thanks

Anu L Sasidharan

avatar
Mentor
In spirit of https://xkcd.com/979/, feel free to mark the thread as resolved if it does help your cause, so others may find a solution quicker.