Should HDF 2.0 ZK nodes be isolated or colocated with NiFi nodes?

[#1]

Planning on installing new HDF 2.0 cluster. Should HDF 2.0 ZK nodes be isolated or colocated with NiFi nodes? I want to colocate. I know NiFi disk need to be dedicated to NiFi. If i can have zk disk isolate from NiFi, I assume CPU might take a hit. Wondering how much and if this is a common practice.

[#2 · Accepted solution]

@Sunile Manjee

As far as best practices goes, we do not recommend installing ZK on the same servers/nodes as NiFi. NiFi dataflows can be very CPU, disk, and/or memory intensive. Any of these can interfere with ZK --> NiFi comms/performance. This can result in NiFi nodes dropping from cluster, new NiFi cluster coordinators being assigned, and/or new primary nodes being elected frequently.

While it does work, i would keep away from co-location in production for sure.

Thank,

Matt