- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
In NiFi how do I append RouteText lines to an existing target file (PutFile functionality)?
- Labels:
-
Apache NiFi
Created ‎10-27-2016 07:38 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I have a RouteText processor outputting matched lines that I would like to append to an existing local file using PutFile. However, PutFile cannot append content to an existing file (am I wrong?). How do I do this in NiFi? Is the only way to do it by using a script in ExecuteScript to open and append a file? Seems like a native Processor should do this.
Created ‎10-29-2016 03:50 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
@Greg Keys unfortunately I think you are correct that ExecuteScript
is the best way to achieve this right now. As far as I know, the PutFile
processor cannot append to an existing file. You are given the option to deal with conflicting files using "replace", "ignore", or "fail" as a resolution strategy. You should submit an Apache Jira to add this functionality. I could see difficulties with file locks and flushing the buffer given the streaming nature of NiFi and I think further investigation is needed.
Created ‎10-29-2016 03:50 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
@Greg Keys unfortunately I think you are correct that ExecuteScript
is the best way to achieve this right now. As far as I know, the PutFile
processor cannot append to an existing file. You are given the option to deal with conflicting files using "replace", "ignore", or "fail" as a resolution strategy. You should submit an Apache Jira to add this functionality. I could see difficulties with file locks and flushing the buffer given the streaming nature of NiFi and I think further investigation is needed.
