Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

How to Kafka topic clone.

Solved Go to solution

How to Kafka topic clone.

Contributor

Can we clone single Kafka topic? If yes then how?

1 ACCEPTED SOLUTION

Accepted Solutions

Re: How to Kafka topic clone.

Contributor

Thank you for sharing the URL. I am looking for topic cloning within the same cluster. Can we do this.

3 REPLIES 3

Re: How to Kafka topic clone.

Super Collaborator

At the basics, you would write a producer that consumes from one topic and produces to another.

MirrorMaker is what you are looking for.

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.2/bk_kafka-component-guide/content/ch_kafka_m...

Re: How to Kafka topic clone.

Contributor

Thank you for sharing the URL. I am looking for topic cloning within the same cluster. Can we do this.

Re: How to Kafka topic clone.

Super Collaborator

Yes, MirrorMaker is not putting a limitation on remote vs local cluster. It is designed for remote clusters because there is almost no need to do it locally. If you are mirroring a topic locally, you must rename it, and if you are going to rename it, then you have consumers/producers using data in both topics?

You are replicating data within the same cluster for little gain while your consumers/producers can easily be configured to use the correct topic(s).