Reply
Highlighted
Explorer
Posts: 6
Registered: ‎11-16-2015

Using KafkaMirror without Zookeeper and Kafka in same cluster.

[ Edited ]

 

Is there a way to run KafkaMirror where both source and destination Kafka servers are in different cluster(and not managed by cloudera).

 

I cant find any configuration in cloudera manager to specify Kafka Broker URL and Zookeeper. I want use cloudera Kafka MirrorMaker so that I can have cloudera manager to monitor the process. 

 

Can anyone suggest a hack to acheive the same ? 

Cloudera Employee
Posts: 275
Registered: ‎01-09-2014

Re: Using KafkaMirror without Zookeeper and Kafka in same cluster.

[ Edited ]

For the source cluster, you should be able to specify 'zookeeper.connect=sourcezk.host.com:2181' In the "Kafka MirrorMaker Advanced Configuration Snippet (Safety Valve) for mirror_maker_consumers.properties" which will query the specified ZK for consuming messages from a remote cluster, and then used the bootstrap.servers setting to specify the destination cluster.

-PD

Announcements
New solutions