- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Delete file after Tailing
- Labels:
-
Apache NiFi
Created on ‎04-01-2021 03:01 AM - edited ‎04-01-2021 03:04 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi,
Created ‎04-01-2021 05:57 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Tailfile stores local/cluster state to check where it has to start tailing again or till what time it has already tailed the log file like List* processor, but state information can not be used by other processor in NiFI to make their own work like flow files attribute value.
Best way I could think of you have you think about buffer time/ retention time for log files and with in that retention time tailfile should be able to taill log files and delete the log files after their retention time, something like whenever ExecuteStreamCommand run for delete it will only delete the files which has last modified time older then X number of days, assuming file which are older then X days is successfully tailed by Tailfile.
Thank You.
