- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Nifi PostgreSQL CDC
- Labels:
-
Apache NiFi
Created 08-07-2017 01:57 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hello,
QueryDatabaseTable processor provides to capture inserts. Is it possible to get updates and deletes without a trigger or postgresql solution?
Regards.
Created 08-07-2017 03:08 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
There's a MySQL CDC processor in NiFi (CaptureChangeMySQL) but no native CDC solution for PostgreSQL currently. You can capture updates by using and updating a timestamp field together with QueryDatabaseTable. Delete are harder to get, you can use logical delete with delayed hard delete to let NiFi get them before. Another option is to use external CDC solution like Attunity.
I hope this helps
Created 08-07-2017 04:54 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Thanks @Abdelkrim Hadjidj.
Do you mean software delete by logical deleting? (Not actually delete, update some fields)
Are there any native solution for mongodb or cassandra?
What do you think about using triggers? (writing insert,delete,update records to a table)
Regards.
Created 02-22-2018 08:02 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I’m finishing this component in nexts 3 weeks... is a processor fto NiFi.
Created 02-22-2018 08:03 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Here a link
Created 11-18-2019 12:34 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
how can i use it
Created 12-10-2021 05:09 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Is there any news how to get this ?
Created 12-10-2021 05:11 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I can't login into Jira of apache. Is there any way for me to get it ?
Created 12-12-2021 01:05 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
sorry? Does he provided the answer somewhere?
