Reply
Highlighted
New Contributor
Posts: 2
Registered: ‎05-27-2017

Spark Streaming - Kafka Deduplication

What is the best way to deduplicate messages coming from Kafka in Spark Streaming consumer? Assuming the producer sends the same message twice.