question Re: Is content purged when flow files are deleted? in Archives of Support Questions (Read Only)

Is content purged when flow files are deleted?

sunile_manjee — Thu, 15 Dec 2016 06:24:21 GMT

In this post https://community.hortonworks.com/questions/71481/finding-and-purging-flow-files.html

it shows how to purge flowfiles from nifi's ui. is the content purged as well? I assume yes, but would like confirmation.

Re: Is content purged when flow files are deleted?

MattWho — Thu, 15 Dec 2016 06:51:12 GMT

@Sunile Manjee

FlowFile Content is stored in claims inside the content repo. Each claim can contain the content from 1 or more FlowFiles. A claim will not be moved to content Archive or purged from the content repository until all active FlowFiles in your dataflow that have references to any of the content in that claim have been removed. Those FlowFiles can be removed via manual purging of the queues (Empty Queue), Flow file expiration on a connection or via auto-termination at the end of a dataflow.

The FlowFile count and size reported in the UI does not reflect the size of the claims the content repo. Those stats report the size and number of active FlowFiles queued in your flow. It is very likely and usual to see the size reported in the UI to differ from actual disk usage.

Thanks,

Matt

Re: Is content purged when flow files are deleted?

MattWho — Thu, 22 Dec 2016 03:00:37 GMT

@Sunile Manjee

Also keep in mind that NiFi Content archiving is enabled by default with a retention period of 12 hours or 50% disk utilization before the archived content is removed/purged. The purging of FlowFile manually within your dataflow will not trigger the deltion of archived FlowFiles.