Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Change Data Capture for Hana View using NiFi

avatar
New Contributor

We have views created in Hana that we ingesting through NiFi with processors and putting into HDFS. We are trying to make sure that new files generated only have Change Data Capture. Is there a possible way?

1 ACCEPTED SOLUTION

avatar
Guru

Hi @John Kuchmek

I think currently out of the box CDC in the latest NiFi works with MySQL using the CaptureChangeMySQL processor. It is likely that the community is working on more CaptureChange processors in future versions. That said, you might be able to follow what was written in this blog post with NiFi to achieve a similar result:

https://hortonworks.com/blog/change-data-capture-using-nifi/

View solution in original post

3 REPLIES 3

avatar
Guru

Hi @John Kuchmek

I think currently out of the box CDC in the latest NiFi works with MySQL using the CaptureChangeMySQL processor. It is likely that the community is working on more CaptureChange processors in future versions. That said, you might be able to follow what was written in this blog post with NiFi to achieve a similar result:

https://hortonworks.com/blog/change-data-capture-using-nifi/

avatar
Guru

@John Kuchmek, there is also the first of three HCC articles about the CaptureChangeMySQL processor here:

https://community.hortonworks.com/articles/113941/change-data-capture-cdc-with-apache-nifi-version-1...

avatar
Master Guru

If you have a id that increments you can use QueryDatabaseTable. CDC will add Postgresql next, Hana is closed source so that connector will be tougher.