Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

In Apache NiFi 1.0, Can I delete older content repositories?

avatar
Master Guru

I have gigabytes of data in them

2.9G494 6.8M664 6.5M625 5.7M640 5.5M661 5.5M649 5.5M569 5.2M412 5.0M678 5.0M622

1 REPLY 1

avatar
Master Guru

The data in the content repository should be controlled through the settings in nifi.properties:

# Content Repository
nifi.content.repository.implementation=org.apache.nifi.controller.repository.FileSystemRepository
nifi.content.claim.max.appendable.size=10 MB
nifi.content.claim.max.flow.files=100
nifi.content.repository.directory.default=./content_repository
nifi.content.repository.archive.max.retention.period=12 hours
nifi.content.repository.archive.max.usage.percentage=50%
nifi.content.repository.archive.enabled=true
nifi.content.repository.always.sync=false
nifi.content.viewer.url=/nifi-content-viewer/

Is the data in the archive folders (underneath each of the folders in the content_repository)?

If so you can turn off archiving using the property above, or reduce the thresholds for how long to hold on to archived data.

If the data is not in the archive folders then it is still deemed to be active in the flow, since multiple flowfiles are bundled together in a content claim, you can have a content claim with some flow files still active and it can't archive the whole thing until they are all no longer in the flow.