Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

merging different schema avro files

avatar

mergecontent.pngI am having 4 avro files. 2 files of Schema1 and other 2 of schema2.i want to merge this into 1 file in NIFI. Using mergecontent, it will merging only 2 files not all 4. Can you please help.(This is batch job and schema changes frequently.)

1 REPLY 1

avatar
Rising Star

@Gayathri, I am not sure about your complete requirement. But, the MergeContent processor is used only when you have to merge the file contents which you have split up-steam using SplitContent processor.

I can suggest you with some workarounds,

1. You may have a common filename for files which follow specific schema

2. Write the file into a local file system using PutFile or into Hadoop using PutHDFS processors

3. Select 'Conflict Resolution Strategy' property to 'Append' when you write the file to disk

Hope this helps.