Nifi content repository works in sync with the Nifi Status bar for sometime after a restart. After that, it starts growing gradually and comes down again only on a restart. I have a mix of small and large files and are merging files to create big files in the flow. I am potentially hitting a bug https://issues.apache.org/jira/browse/NIFI-6150 which is not working for probably the below mentioned three scenarios: 1) Having both small and big files. 2) Merging small files to create big files. I have a few big files which only go after a restart. 3) Merge content without any failures holds onto flow files for days after the flow file has left flow. Data flow for this Nifi is 24 TB per day and restart is causing huge lags.
... View more