We've recently ran into an issue with ZK failing the Quorum Membership Test along with the canary test, which could be due to any number of reasons, however I'm having trouble finding what CM actually does to perform this test or evidence of it being done.
I'm assuming it's connecting on 2181(or 3181 quorum membership port?) and attempting to query the leader/follower for each member and then attempting to write to the root directory using telnet or zkcli.
Is there a detailed look at what commands are being performed somewhere? I've read the descriptions, but they seem to generalize the steps, something more precise like what is displayed for the start/stop of services would be fantastic.