Support Questions
Find answers, ask questions, and share your expertise

HDF on HDP cluster sharing Zookeeper

HDF on HDP cluster sharing Zookeeper

Explorer

For deployment of HDF on a fresh HDP production cluster (total size < 100), will the HDF services such as Kafka, Storm and Nifi use the HDP Zookeeper cluster, or a separate dedicated Zookeeper quorum must be installed for the HDF services ?

If the same Zookeeper quorum is used, is 3 ZK nodes enough or should I consider 5 ZK nodes for a 60-node cluster (combined) ?

1 REPLY 1

Re: HDF on HDP cluster sharing Zookeeper

Guru

Hi @Alireza, I strongly suggest to use a separate zookeeper cluster for HDF as it would be heavily loaded; Sharing a ZK cluster between HDP and HDF would definitely be a pain point and a bottleneck