Member since
10-03-2017
14
Posts
1
Kudos Received
0
Solutions
02-23-2019
11:03 AM
Try this NIFI groovy processor it converts XML files to CSV or AVRO https://github.com/maxbback/nifi-xml
... View more
02-23-2019
11:01 AM
If you like to use NIFI instead you can try this groovy script https://github.com/maxbback/nifi-xml
... View more
02-23-2019
10:58 AM
You can also try this NIFI groovy processor that converts XML to CSV https://github.com/maxbback/nifi-xml
... View more
02-23-2019
10:53 AM
You can use this NIFI Groovy processor that converts XML to CSV or AVRO https://github.com/maxbback/nifi-xml
... View more
07-18-2018
10:58 AM
Hi Last week I wrote a version of my XML2CSV but for AVRO It is still under improvement but you can check it out here Git Repo xml2avro Article XML2Avro NiFi processor
... View more
07-01-2018
01:59 PM
Hi XML tree is a complex as they are hierarchical and you most likely want a flat structure for easier access of the data. I just wrapped up the second article of this yesterday, and the code for this is available at GitHub link included in the article. http://max.bback.se/index.php/2018/06/30/xml-to-tables-csv-with-nifi-and-groovy-part-2-of-2/ The article describe the problem and is providing an implementation for the conversion from XML to CSV by flattening out the XML files, my example XML is flattened out into 4 tables, all depends on how many branches you have that is of the type 1 to many. /Max
... View more
03-11-2018
12:43 PM
Hi Kylo is providing the functionality you are looking for They have a concept together with nifi which is called reusable flow This flow can be connected to any feed templates and in the end all feeds hook into the same reusable flow in nifi So in short you create a flow in nifi with input port, create a template of this flow the reusable flow, export it and inport the file as a reusable flow in kylo. Create your feed template flows in nifi and create template of them, import the template from nifi in kylo and connect the output port of your template to the input port of the reusable flow. Create a feed in kylo from your template. Kilo will then generate a feed based on your feed template in nifi and connect this to the reusable flow. You can now modify your reusable flow and create a new template in nifi with the same name as the previous version of the reusable flow, export it to a file and import it to kylo and all your feeds are now connected to the new version of your reusable flow. If you do not want to use Kylo there is an alternative you create a group called reusable flow In this group you create a group called reusable flow v1 You connect your feeds to the input port on the reusable flow group And inside of the reusable flow you connect it to the v1 groups input port Now you want to make a new version of your reusable flow You make a copy of the group v1 to v2 Make the changes you want to do inside of v2, when you are satisfied you disconnect v1 and connect v2 instead. In this way it is very easy to switch to a new version without having to change any of your feeds. Below is link to youtube that describe the kylo reusable flow, but if you are only in nifi I recommend the groups in groups to maintain different versions as you then can easily switch back and forward without impacting all your feeds https://www.youtube.com/watch?v=Vj641MRJCd8
... View more
12-08-2017
07:41 AM
What if you need to run a few joins to be able to get all the data? Is there then another way of doing this wish a llows a more complex query but still allows a watermark column to be used?
... View more
10-03-2017
06:40 AM
Hi Matt Do you have any code that is using avro instead of json to manipulate the data? /Max
... View more