Created on 11-07-2022 02:28 AM - edited 11-07-2022 02:29 AM
So I am using SplitXml processor to split flowfile. After some transformations I am merging those flowfiles back together using MrgeContent. After mergning I have noticed that not all of the flow files merged together. e.g. I have splitted my flowfile on 100 parts and after merging I've got 2 files with 50 records of my initial flow file each. When i set Run schedule option to 10 seconds instead of 1 it merged all files together. But what if i don't know how many flowfiles i will get after split and how much time it will take for merge processor to merge it? I use flowfile name as Correlation attribute name.
Thank you beforehand!
Created 11-07-2022 02:37 AM
When using SplitXML to split the flowfiles, SpilitXML writes the details of the following attributes in each split flow files, fragment. identifier, fragment.index, fragment.count, segment.original.filename if needed to be merged later then MrgeContent should be configured with Merge Strategy : Defragment "The 'Defragment' algorithm combines fragments that are associated by attributes back into a single cohesive FlowFile"
Are you doing the same ? with MergeContent?
If you found this response assisted with your issue, please take a moment to login and click on "Accept as Solution" below this post.
Thank you,
Chandan
Created 11-07-2022 02:37 AM
When using SplitXML to split the flowfiles, SpilitXML writes the details of the following attributes in each split flow files, fragment. identifier, fragment.index, fragment.count, segment.original.filename if needed to be merged later then MrgeContent should be configured with Merge Strategy : Defragment "The 'Defragment' algorithm combines fragments that are associated by attributes back into a single cohesive FlowFile"
Are you doing the same ? with MergeContent?
If you found this response assisted with your issue, please take a moment to login and click on "Accept as Solution" below this post.
Thank you,
Chandan
Created 11-07-2022 02:42 AM
Thank you kinds sir! My problem was solved!!