Support Questions
Find answers, ask questions, and share your expertise

HDF on HDP cluster sharing Zookeeper


For deployment of HDF on a fresh HDP production cluster (total size < 100), will the HDF services such as Kafka, Storm and Nifi use the HDP Zookeeper cluster, or a separate dedicated Zookeeper quorum must be installed for the HDF services ?

If the same Zookeeper quorum is used, is 3 ZK nodes enough or should I consider 5 ZK nodes for a 60-node cluster (combined) ?



Hi @Alireza, I strongly suggest to use a separate zookeeper cluster for HDF as it would be heavily loaded; Sharing a ZK cluster between HDP and HDF would definitely be a pain point and a bottleneck

Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.