Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Ingest same data in Kafka topic

Solved Go to solution

Ingest same data in Kafka topic

Contributor

Team,

What will be happened if we ingest same data, in particular, Kafka topic again? Will it overwrite the data or will make another copy of data or it will just ignore and notify.

1 ACCEPTED SOLUTION

Accepted Solutions

Re: Ingest same data in Kafka topic

Hi @Nilesh

There's no relation between data in two different topics. Reading from one topic and writing to another one will copy (and duplicate) data

4 REPLIES 4

Re: Ingest same data in Kafka topic

Hi @Nilesh

There's no relation between data in two different topics. Reading from one topic and writing to another one will copy (and duplicate) data

Highlighted

Re: Ingest same data in Kafka topic

Contributor

Hi @ Abdelkrim Hadjidj

Thank you for the reply. My question is I am ingesting same data again and again on the same topic then what will happen? Will it overwrite the data or will make another copy of data or it will just ignore and notify?

Thank you.

Re: Ingest same data in Kafka topic

@Nilesh same answer for one topic. If you send the same data several times to Kafka you will get it several times when you consume.

Re: Ingest same data in Kafka topic

Cloudera Employee

Just look at Kafka as a distibuted log file. even if you insert the same data, again and again, it just appends the data into a distibuted log file.