Skip to main content
phaelax
Bronze ⭐️⭐️⭐️
Jan 31, 2023 7:38 PM UTC
Question

How to send flowfile to another nifi instance?

Can someone tell me if these is even possible.  We want to send a file through nifi to another nifi server on a different network, thus nifi is the only tunnel of communication between the two networks.  If we can send just the file data I'm ok with that. If we can maintain the attributes and send the actual flowfile then even better.

1 reply

MattWho
Titanium ⭐️⭐️⭐️
Titanium ⭐️⭐️⭐️
Feb 2, 2023 9:17 PM UTC

@phaelax 

This is very possible and very commonly done.

NiFi's Remote Process Group (RPG) is commonly used (recommended method) to transfer NiFi FlowFiles between different NiFi instances or even different NiFi clusters:

https://nifi.apache.org/docs/nifi-docs/html/user-guide.html#Remote_Group_Transmission

https://nifi.apache.org/docs/nifi-docs/html/user-guide.html#remote_group_anatomy

 

When a direct connection between NiFi's can't be made, you can also use the mergeContent processor to "FlowFile Stream, v3" to merge numerous FlowFiles (includes FlowFile attributes) in to a single FlowFile that can be transferred by any means to another NiFi where it can be ingested and use the unpackContent processor to unplack that into the original FlowFiles with their original attributes.

 

If you found that the provided solution(s) assisted you with your query, please take a moment to login and click Accept as Solution below each response that helped.

Thank you,

Matt

Translate