question Re: Change Data Capture for Hana View using NiFi in Archives of Support Questions (Read Only)

Change Data Capture for Hana View using NiFi

john_kuchmek — Thu, 10 Aug 2017 21:03:01 GMT

We have views created in Hana that we ingesting through NiFi with processors and putting into HDFS. We are trying to make sure that new files generated only have Change Data Capture. Is there a possible way?

Re: Change Data Capture for Hana View using NiFi

ssahi — Thu, 10 Aug 2017 22:52:59 GMT

Hi @John Kuchmek

I think currently out of the box CDC in the latest NiFi works with MySQL using the CaptureChangeMySQL processor. It is likely that the community is working on more CaptureChange processors in future versions. That said, you might be able to follow what was written in this blog post with NiFi to achieve a similar result:

https://hortonworks.com/blog/change-data-capture-using-nifi/

Re: Change Data Capture for Hana View using NiFi

alim — Thu, 10 Aug 2017 23:07:18 GMT

@John Kuchmek, there is also the first of three HCC articles about the CaptureChangeMySQL processor here:

https://community.hortonworks.com/articles/113941/change-data-capture-cdc-with-apache-nifi-version-1-1.html

Re: Change Data Capture for Hana View using NiFi

TimothySpann — Fri, 11 Aug 2017 00:45:54 GMT

If you have a id that increments you can use QueryDatabaseTable. CDC will add Postgresql next, Hana is closed source so that connector will be tougher.