NiFi doesn't currently support MS SQL, but it appears there is a NiFi contributor who has it in the works: https://github.com/apache/nifi/pull/2231 Not sure if the solutions uses transactional logs or not. ... View more

Hi @Deb Yes, I wrote on article for doing CDC with NiFi for a MySQL database: https://community.hortonworks.com/articles/113941/change-data-capture-cdc-with-apache-nifi-version-1-1.html NiFi doesn't currently support MS SQL, but it appears there is a NiFi contributor who has it in the works: https://github.com/apache/nifi/pull/2231 Not sure if the solutions uses transactional logs or not. ... View more

Thanks for the information Nitin. It seems like it would make sense to "clean up" your incoming XML using the TransformXML processor (https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.6.0/org.apache.nifi.processors.standard.TransformXml/) prior to ConvertRecord since there is data there like the header info that you don't care about for the CSV file. Additionally, could change the tag from `p` to its `name` attribute. I haven't used the TransformXML processor before (or worked with XSLT files before). Take a look yourself and see if you think it could be a solution for you. I will try it out myself if I get the opportunity. ... View more

Hi @Nitin Damle I'm assuming you got the flow working with the sample data and template I provided. Can you provide an example of the desired csv output you are hoping to achieve from the cm_samples.xml file you provided? That would help me understand your end goal for the flow. Thanks! ... View more

One thing, I wanted to note. For the XMLReader controller service (https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-record-serialization-services-nar/1.9.0/org.apache.nifi.xml.XMLReader/index.html), I needed to set the Expect Records as Array property to "true". ... View more

Hi @Nitin Damle Here is the XML to CSV template: convert-xml-to-csv.xml Here is the sample XML file to use: users.xml If you find these helpful, please "Accept" my original answer from February 14th as this template is the implementation of what I suggested to do. ... View more

Hi @Emil Brännström Thanks for your comments. I hope we can get the flow working for you end-to-end. The copy.users table should be automatically created, assuming you are capturing all the ddl events needed for it (the 1 DDL event for the creation of the 'users' table, 1 begin event, X # of insert events for the rows added to the table, and 1 commit event). What are the flowfile contents after CaptureChangeMySQL? It might also be helpful to check some of the troubleshooting tips in the third article, especially the ones regarding clearing state. ... View more

Hi @Nitin Damle It would be helpful if you selected "Reply" to each of my comments instead of adding new Answers, which makes the readability of this question more difficult. Understandably, the "Reply" link is very small and hard to see. Are you modifying the template prior to uploading it into NiFi? That was the issue in the other HCC article you referenced (https://community.hortonworks.com/questions/226390/nifi-18-error-updateattribute-is-not-known-to-this.html). Because the template was malformed, it gave that error. ... View more

@Nitin Damle convert-cvs-to-xml.xml If you are still having problems uploading the template, can you confirm what version of NiFi you are on? I just did a test in NiFi 1.8.0 and the upload was successful. ... View more