Change Data Capture for Hana View using NiFi

[#1]

We have views created in Hana that we ingesting through NiFi with processors and putting into HDFS. We are trying to make sure that new files generated only have Change Data Capture. Is there a possible way?

[#2 · Accepted solution]

Hi @John Kuchmek

I think currently out of the box CDC in the latest NiFi works with MySQL using the CaptureChangeMySQL processor. It is likely that the community is working on more CaptureChange processors in future versions. That said, you might be able to follow what was written in this blog post with NiFi to achieve a similar result:

https://hortonworks.com/blog/change-data-capture-using-nifi/

[#3]

@John Kuchmek, there is also the first of three HCC articles about the CaptureChangeMySQL processor here:

https://community.hortonworks.com/articles/113941/change-data-capture-cdc-with-apache-nifi-version-1...

[#4]

If you have a id that increments you can use QueryDatabaseTable. CDC will add Postgresql next, Hana is closed source so that connector will be tougher.