Archives of Support Questions (Read Only)

This is an archived board for historical reference. Information and links may no longer be available or relevant
Announcements
This board is archived and read-only for historical reference. To ask a new question, please post a new topic on the appropriate active board.

Should HDF 2.0 ZK nodes be isolated or colocated with NiFi nodes?

avatar
Master Guru

Planning on installing new HDF 2.0 cluster. Should HDF 2.0 ZK nodes be isolated or colocated with NiFi nodes? I want to colocate. I know NiFi disk need to be dedicated to NiFi. If i can have zk disk isolate from NiFi, I assume CPU might take a hit. Wondering how much and if this is a common practice.

1 ACCEPTED SOLUTION

avatar
Master Mentor
@Sunile Manjee

As far as best practices goes, we do not recommend installing ZK on the same servers/nodes as NiFi. NiFi dataflows can be very CPU, disk, and/or memory intensive. Any of these can interfere with ZK --> NiFi comms/performance. This can result in NiFi nodes dropping from cluster, new NiFi cluster coordinators being assigned, and/or new primary nodes being elected frequently.

While it does work, i would keep away from co-location in production for sure.

Thank,

Matt

View solution in original post

1 REPLY 1

avatar
Master Mentor
@Sunile Manjee

As far as best practices goes, we do not recommend installing ZK on the same servers/nodes as NiFi. NiFi dataflows can be very CPU, disk, and/or memory intensive. Any of these can interfere with ZK --> NiFi comms/performance. This can result in NiFi nodes dropping from cluster, new NiFi cluster coordinators being assigned, and/or new primary nodes being elected frequently.

While it does work, i would keep away from co-location in production for sure.

Thank,

Matt