Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Kafka mirror maker deployment

Highlighted

Kafka mirror maker deployment

Explorer

I have a Kafka cluster composed by 5 brokers and 4 mirror maker to mirror date from 2 different data centers. I know that a kafka broker requires its own dedicated hardware especially because of the high disk I/O, memory usage and CPU intensive application.

I would like to know if could make sense to deploy a mirror maker process on a node that is even a Kafka broker or if I should consider to have the mirror maker on:

- a dedicated node

- a node which hostes a zookeeper server

 

HDFS and others cloudera services are deployed on different nodes.

Thanks in advance,

Beniamino

1 REPLY 1

Re: Kafka mirror maker deployment

Cloudera Employee

For a basic setup you can have it on the same node (e.g. for testing or low volume usage). 

 

Please see the below considerations when deploying services into nodes:

https://www.cloudera.com/documentation/enterprise/release-notes/topics/hardware_requirements_guide.h...