Support Questions
Find answers, ask questions, and share your expertise

Merge 2 different incoming single flow file attribute (not merging content ) for future storage into postgresql

Explorer

Hi, 

 

Would like to seek an example of caching the 2 singe flow file attribute (filename attribute) and store it for later part processing. 

 

Scenario:

1) Folder containing (file1.xml and file2.txt)

2) Using NiFi GetFile processor to get both file

3) Get the attribute of both files (filename) 

4) store it for future storage into database 

 

Looking forward for the help with example and explanation. Appreciate the helps. Thanks 

 

1 REPLY 1

Master Guru

@techNerd 

 

After you fetch the two files, you could route the success relationship twice via two different connections.  One of those connection continues those two files down you r existing dataflow path.  The secondary path could go to a replaceText processor that replaces the entire content of the FlowFile with the filename which is store in a FlowFile attribute named "filename".  Editing the content down this secondary path does not affect the content of the FlowFile in the other dataflow path.

Now that you have the filename in the content you can use other processors to store that content with the filename wherever you want for future retrieval.  or you could merge those flowfile in to single FlowFile that would then contain the list of filenames before you store it.  This is just a matter of your specific use case for later consumption of this stored data.

 

Take a look at the putDistributedMapCache processor as an example.

If you found this response addressed your query, please take a moment to login and click on "Accept as Solution" below this post.

 

Thank you,

Matt

Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.