https://community.cloudera.com/t5/Archives-of-Support-Questions/Kafka-MirrorMaker-compression-over-the-wire/m-p/95671#M9027 <P><A href="http://community.hortonworks.com/users/104/sball.html">@Simon Elliston Ball</A></P><P>You need to use "Shallow iteration" to publish the message as is.</P><P>This is described in <A href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=27846330">Mirror Maker (Compression Section)</A></P> Wed, 21 Oct 2015 00:10:22 GMT Jagatheeshr 2015-10-21T00:10:22Z https://community.cloudera.com/t5/Archives-of-Support-Questions/Kafka-MirrorMaker-compression-over-the-wire/m-p/95670#M9026 <P>Mirror Maker works by consuming a source Kafka and producing into a destination Kafka. </P><P>If I am producing messages with compression enabled into the source Kafka, is there a way to consume them in Mirror Maker without decompression, ie, just grab the raw compressed bits, and pass those on the wire to the target Kafka, or will the Consumer force decompression and recompression at the other end (meaning uncompressed data goes over the wire)?</P> Tue, 20 Oct 2015 18:48:52 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/Kafka-MirrorMaker-compression-over-the-wire/m-p/95670#M9026 sball 2015-10-20T18:48:52Z https://community.cloudera.com/t5/Archives-of-Support-Questions/Kafka-MirrorMaker-compression-over-the-wire/m-p/95671#M9027 <P><A href="http://community.hortonworks.com/users/104/sball.html">@Simon Elliston Ball</A></P><P>You need to use "Shallow iteration" to publish the message as is.</P><P>This is described in <A href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=27846330">Mirror Maker (Compression Section)</A></P> Wed, 21 Oct 2015 00:10:22 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/Kafka-MirrorMaker-compression-over-the-wire/m-p/95671#M9027 Jagatheeshr 2015-10-21T00:10:22Z