Member since
08-12-2020
3
Posts
0
Kudos Received
0
Solutions
08-22-2022
06:36 PM
Correct, it is currently mounted on every node. I would have thought Nifi would dropped the file state once log files are deleted or archived but does not look like it. I could see 15K file states on the tailing processor.
... View more
08-18-2022
07:59 PM
I am guessing as state location is set to remote, this seems to have gone into zk's transaction log and filling up disk space fast. we are seeing transaction log growing up to 30GB. Hence, we are looking if there is a way to clean-up state to only existing files.
... View more
08-17-2022
07:39 PM
We are using Nifi TailFile to tail multiple files in a directory and state location is set to "remote". It looks like Nifi is keeping the file state even after the file is deleted. is there a way to remove deleted file from the state, manually or automatically?
... View more
Labels:
- Labels:
-
Apache NiFi