Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

How to Convert XML file into CSV file using NIFI

Solved Go to solution

How to Convert XML file into CSV file using NIFI

New Contributor

i have XML files about 1-2 GB i want it to convert into CSV format using apache nifi.

so that i can process CSV for joining the two csv.

1 ACCEPTED SOLUTION

Accepted Solutions

Re: How to Convert XML file into CSV file using NIFI

Guru

Hi @Nitin Damle

You can use the ConvertRecord processor (with XMLReader/CSVRecordSetWriter controller services). I have an article here that shows CSV to XML (with CSVReader/XMLRecordSetWriter controller services), so you just need to do the inverse of that record transformation:

https://community.hortonworks.com/content/kbentry/199310/xml-record-writer-in-apache-nifi-170.html

-Andrew

20 REPLIES 20

Re: How to Convert XML file into CSV file using NIFI

Guru

Hi @Nitin Damle

You can use the ConvertRecord processor (with XMLReader/CSVRecordSetWriter controller services). I have an article here that shows CSV to XML (with CSVReader/XMLRecordSetWriter controller services), so you just need to do the inverse of that record transformation:

https://community.hortonworks.com/content/kbentry/199310/xml-record-writer-in-apache-nifi-170.html

-Andrew

Re: How to Convert XML file into CSV file using NIFI

New Contributor

@Andrew Lim

can you please upload the template here i have tried to upload template given in link but it throwing error

Re: How to Convert XML file into CSV file using NIFI

Guru

@Nitin Damle

convert-cvs-to-xml.xml

If you are still having problems uploading the template, can you confirm what version of NiFi you are on? I just did a test in NiFi 1.8.0 and the upload was successful.

Re: How to Convert XML file into CSV file using NIFI

Guru

Hi @Nitin Damle

It would be helpful if you selected "Reply" to each of my comments instead of adding new Answers, which makes the readability of this question more difficult. Understandably, the "Reply" link is very small and hard to see.

Are you modifying the template prior to uploading it into NiFi? That was the issue in the other HCC article you referenced (https://community.hortonworks.com/questions/226390/nifi-18-error-updateattribute-is-not-known-to-thi...). Because the template was malformed, it gave that error.

Highlighted

Re: How to Convert XML file into CSV file using NIFI

New Contributor

@Andrew Lim can you upload the template for XML to CSV with sample data .


Re: How to Convert XML file into CSV file using NIFI

Guru

Hi @Nitin Damle

Here is the XML to CSV template: convert-xml-to-csv.xml

Here is the sample XML file to use: users.xml

If you find these helpful, please "Accept" my original answer from February 14th as this template is the implementation of what I suggested to do.

Re: How to Convert XML file into CSV file using NIFI

Guru

One thing, I wanted to note. For the XMLReader controller service (https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-record-serialization-services...), I needed to set the Expect Records as Array property to "true".

Re: How to Convert XML file into CSV file using NIFI

New Contributor

Thanks @Andrew Lim

Re: How to Convert XML file into CSV file using NIFI

New Contributor

@Andrew Lim , i am getting header only not data


cm_samples.xml


schema.txt


i attached my schema and xml pls let me know where i am going wrong

Don't have an account?
Coming from Hortonworks? Activate your account here