Support Questions

Find answers, ask questions, and share your expertise
Announcements
Check out our newest addition to the community, the Cloudera Data Analytics (CDA) group hub.

Should HDF 2.0 ZK nodes be isolated or colocated with NiFi nodes?

Super Guru

Planning on installing new HDF 2.0 cluster. Should HDF 2.0 ZK nodes be isolated or colocated with NiFi nodes? I want to colocate. I know NiFi disk need to be dedicated to NiFi. If i can have zk disk isolate from NiFi, I assume CPU might take a hit. Wondering how much and if this is a common practice.

1 ACCEPTED SOLUTION

Mentor
@Sunile Manjee

As far as best practices goes, we do not recommend installing ZK on the same servers/nodes as NiFi. NiFi dataflows can be very CPU, disk, and/or memory intensive. Any of these can interfere with ZK --> NiFi comms/performance. This can result in NiFi nodes dropping from cluster, new NiFi cluster coordinators being assigned, and/or new primary nodes being elected frequently.

While it does work, i would keep away from co-location in production for sure.

Thank,

Matt

View solution in original post

1 REPLY 1

Mentor
@Sunile Manjee

As far as best practices goes, we do not recommend installing ZK on the same servers/nodes as NiFi. NiFi dataflows can be very CPU, disk, and/or memory intensive. Any of these can interfere with ZK --> NiFi comms/performance. This can result in NiFi nodes dropping from cluster, new NiFi cluster coordinators being assigned, and/or new primary nodes being elected frequently.

While it does work, i would keep away from co-location in production for sure.

Thank,

Matt

Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.