Kafka MirrorMaker compression over the wire

[#1]

Mirror Maker works by consuming a source Kafka and producing into a destination Kafka.

If I am producing messages with compression enabled into the source Kafka, is there a way to consume them in Mirror Maker without decompression, ie, just grab the raw compressed bits, and pass those on the wire to the target Kafka, or will the Consumer force decompression and recompression at the other end (meaning uncompressed data goes over the wire)?

[#2 · Accepted solution]

@Simon Elliston Ball

You need to use "Shallow iteration" to publish the message as is.

This is described in Mirror Maker (Compression Section)