Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Using KafkaMirror without Zookeeper and Kafka in same cluster.

Using KafkaMirror without Zookeeper and Kafka in same cluster.

Explorer

 

Is there a way to run KafkaMirror where both source and destination Kafka servers are in different cluster(and not managed by cloudera).

 

I cant find any configuration in cloudera manager to specify Kafka Broker URL and Zookeeper. I want use cloudera Kafka MirrorMaker so that I can have cloudera manager to monitor the process. 

 

Can anyone suggest a hack to acheive the same ? 

1 REPLY 1
Highlighted

Re: Using KafkaMirror without Zookeeper and Kafka in same cluster.

Super Collaborator

For the source cluster, you should be able to specify 'zookeeper.connect=sourcezk.host.com:2181' In the "Kafka MirrorMaker Advanced Configuration Snippet (Safety Valve) for mirror_maker_consumers.properties" which will query the specified ZK for consuming messages from a remote cluster, and then used the bootstrap.servers setting to specify the destination cluster.

-PD