Support Questions
Find answers, ask questions, and share your expertise

Kafka MirrorMaker compression over the wire

Solved Go to solution
Highlighted

Kafka MirrorMaker compression over the wire

Guru

Mirror Maker works by consuming a source Kafka and producing into a destination Kafka.

If I am producing messages with compression enabled into the source Kafka, is there a way to consume them in Mirror Maker without decompression, ie, just grab the raw compressed bits, and pass those on the wire to the target Kafka, or will the Consumer force decompression and recompression at the other end (meaning uncompressed data goes over the wire)?

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted

Re: Kafka MirrorMaker compression over the wire

@Simon Elliston Ball

You need to use "Shallow iteration" to publish the message as is.

This is described in Mirror Maker (Compression Section)

View solution in original post

1 REPLY 1
Highlighted

Re: Kafka MirrorMaker compression over the wire

@Simon Elliston Ball

You need to use "Shallow iteration" to publish the message as is.

This is described in Mirror Maker (Compression Section)

View solution in original post