- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
How to send flowfile to another nifi instance?
- Labels:
-
Apache NiFi
Created 01-31-2023 11:38 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Can someone tell me if these is even possible. We want to send a file through nifi to another nifi server on a different network, thus nifi is the only tunnel of communication between the two networks. If we can send just the file data I'm ok with that. If we can maintain the attributes and send the actual flowfile then even better.
Created 02-02-2023 01:17 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
@phaelax
This is very possible and very commonly done.
NiFi's Remote Process Group (RPG) is commonly used (recommended method) to transfer NiFi FlowFiles between different NiFi instances or even different NiFi clusters:
https://nifi.apache.org/docs/nifi-docs/html/user-guide.html#Remote_Group_Transmission
https://nifi.apache.org/docs/nifi-docs/html/user-guide.html#remote_group_anatomy
When a direct connection between NiFi's can't be made, you can also use the mergeContent processor to "FlowFile Stream, v3" to merge numerous FlowFiles (includes FlowFile attributes) in to a single FlowFile that can be transferred by any means to another NiFi where it can be ingested and use the unpackContent processor to unplack that into the original FlowFiles with their original attributes.
If you found that the provided solution(s) assisted you with your query, please take a moment to login and click Accept as Solution below each response that helped.
Thank you,
Matt
