Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Nifi PostgreSQL CDC

avatar
Expert Contributor

Hello,

QueryDatabaseTable processor provides to capture inserts. Is it possible to get updates and deletes without a trigger or postgresql solution?

Regards.

8 REPLIES 8

avatar

Hi @Mustafa Kemal MAYUK

There's a MySQL CDC processor in NiFi (CaptureChangeMySQL) but no native CDC solution for PostgreSQL currently. You can capture updates by using and updating a timestamp field together with QueryDatabaseTable. Delete are harder to get, you can use logical delete with delayed hard delete to let NiFi get them before. Another option is to use external CDC solution like Attunity.

I hope this helps

avatar
Expert Contributor

Thanks @Abdelkrim Hadjidj.

Do you mean software delete by logical deleting? (Not actually delete, update some fields)

Are there any native solution for mongodb or cassandra?

What do you think about using triggers? (writing insert,delete,update records to a table)

Regards.

avatar
Contributor

I’m finishing this component in nexts 3 weeks... is a processor fto NiFi.

avatar
Contributor

Here a link

CDC PostgreSQL

avatar
New Contributor

how can i use it

avatar
Explorer

Is there any news how to get this ?

avatar
Explorer

I can't login into Jira of apache. Is there any way for me to get it ?

avatar
Explorer

sorry? Does he provided the answer somewhere?