How to send flowfile to another nifi instance?

phaelax — Tue, 31 Jan 2023 19:38:49 GMT

Can someone tell me if these is even possible. We want to send a file through nifi to another nifi server on a different network, thus nifi is the only tunnel of communication between the two networks. If we can send just the file data I'm ok with that. If we can maintain the attributes and send the actual flowfile then even better.

Re: How to send flowfile to another nifi instance?

MattWho — Thu, 02 Feb 2023 21:17:37 GMT

@phaelax

This is very possible and very commonly done.

NiFi's Remote Process Group (RPG) is commonly used (recommended method) to transfer NiFi FlowFiles between different NiFi instances or even different NiFi clusters:

https://nifi.apache.org/docs/nifi-docs/html/user-guide.html#Remote_Group_Transmission

https://nifi.apache.org/docs/nifi-docs/html/user-guide.html#remote_group_anatomy

When a direct connection between NiFi's can't be made, you can also use the mergeContent processor to "FlowFile Stream, v3" to merge numerous FlowFiles (includes FlowFile attributes) in to a single FlowFile that can be transferred by any means to another NiFi where it can be ingested and use the unpackContent processor to unplack that into the original FlowFiles with their original attributes.

If you found that the provided solution(s) assisted you with your query, please take a moment to login and click Accept as Solution below each response that helped.

Thank you,

Matt

question Re: How to send flowfile to another nifi instance? in Support Questions

How to send flowfile to another nifi instance?

Re: How to send flowfile to another nifi instance?