Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Kafka MirrorMaker compression over the wire

Solved Go to solution

Kafka MirrorMaker compression over the wire

Guru

Mirror Maker works by consuming a source Kafka and producing into a destination Kafka.

If I am producing messages with compression enabled into the source Kafka, is there a way to consume them in Mirror Maker without decompression, ie, just grab the raw compressed bits, and pass those on the wire to the target Kafka, or will the Consumer force decompression and recompression at the other end (meaning uncompressed data goes over the wire)?

1 ACCEPTED SOLUTION

Accepted Solutions

Re: Kafka MirrorMaker compression over the wire

@Simon Elliston Ball

You need to use "Shallow iteration" to publish the message as is.

This is described in Mirror Maker (Compression Section)

1 REPLY 1

Re: Kafka MirrorMaker compression over the wire

@Simon Elliston Ball

You need to use "Shallow iteration" to publish the message as is.

This is described in Mirror Maker (Compression Section)

Don't have an account?
Coming from Hortonworks? Activate your account here