03-12-2016 02:24 AM - edited 03-12-2016 02:31 AM
Is there a way to run KafkaMirror where both source and destination Kafka servers are in different cluster(and not managed by cloudera).
I cant find any configuration in cloudera manager to specify Kafka Broker URL and Zookeeper. I want use cloudera Kafka MirrorMaker so that I can have cloudera manager to monitor the process.
Can anyone suggest a hack to acheive the same ?
03-31-2016 09:22 PM - edited 03-31-2016 09:24 PM
For the source cluster, you should be able to specify 'zookeeper.connect=sourcezk.host.com:2181' In the "Kafka MirrorMaker Advanced Configuration Snippet (Safety Valve) for mirror_maker_consumers.properties" which will query the specified ZK for consuming messages from a remote cluster, and then used the bootstrap.servers setting to specify the destination cluster.