Support Questions

Find answers, ask questions, and share your expertise

How to send flowfile to another nifi instance?

avatar
New Contributor

Can someone tell me if these is even possible.  We want to send a file through nifi to another nifi server on a different network, thus nifi is the only tunnel of communication between the two networks.  If we can send just the file data I'm ok with that. If we can maintain the attributes and send the actual flowfile then even better.

1 REPLY 1

avatar
Master Mentor

@phaelax 

This is very possible and very commonly done.

NiFi's Remote Process Group (RPG) is commonly used (recommended method) to transfer NiFi FlowFiles between different NiFi instances or even different NiFi clusters:

https://nifi.apache.org/docs/nifi-docs/html/user-guide.html#Remote_Group_Transmission

https://nifi.apache.org/docs/nifi-docs/html/user-guide.html#remote_group_anatomy

 

When a direct connection between NiFi's can't be made, you can also use the mergeContent processor to "FlowFile Stream, v3" to merge numerous FlowFiles (includes FlowFile attributes) in to a single FlowFile that can be transferred by any means to another NiFi where it can be ingested and use the unpackContent processor to unplack that into the original FlowFiles with their original attributes.

 

If you found that the provided solution(s) assisted you with your query, please take a moment to login and click Accept as Solution below each response that helped.

Thank you,

Matt