Thanks for your response. So can i say that Kafka which is managed zookeeper. is not a right messaging platform for 2 Rack network infrastructure to achieve seamless rack fault tolerant mechanism. Or any other mechanism exists ?
Thanks again. This gives me an idea of setting up Kafka cluster in VM environment which is then connected to my actual existing servers.
How about Kafka mirroring ? Can these be useful concept of achieving fault tolerance in case of rack failure ? And how will zookeeper ensemble looks in it ? Will it be standalone on both the rack and the target rack zookeeper gets activated when source rack goes down ?
Not sure I understand correctly your question about zookeeper.
If you want to be able to survive a rack failure then you need to spread your zookeeper cluster among a 3 rack topology (minimum).
That way, if you loose 1 rack, then the zookeeper quorum will still be in good shape on the 2 racks still available.
I was referring to the concept of Kafka Mirroring -
If this is implemented then can it be used to achieve rack fault tolerance across 2 racks cluster setup ? My limit is to implement scalable & fault tolerant messaging layer with 2 Rack infrastructure.
Thanks so much for your inputs.
So is there any recommended solution (software based) to achieve rack failure fault tolerance capability with 2 racks. !! 🙂