Support Questions
Find answers, ask questions, and share your expertise
Announcements
Check out our newest addition to the community, the Cloudera Innovation Accelerator group hub.

In Apache NiFi 1.0, Can I delete older content repositories?

Super Guru

I have gigabytes of data in them

2.9G494 6.8M664 6.5M625 5.7M640 5.5M661 5.5M649 5.5M569 5.2M412 5.0M678 5.0M622

1 REPLY 1

The data in the content repository should be controlled through the settings in nifi.properties:

# Content Repository
nifi.content.repository.implementation=org.apache.nifi.controller.repository.FileSystemRepository
nifi.content.claim.max.appendable.size=10 MB
nifi.content.claim.max.flow.files=100
nifi.content.repository.directory.default=./content_repository
nifi.content.repository.archive.max.retention.period=12 hours
nifi.content.repository.archive.max.usage.percentage=50%
nifi.content.repository.archive.enabled=true
nifi.content.repository.always.sync=false
nifi.content.viewer.url=/nifi-content-viewer/

Is the data in the archive folders (underneath each of the folders in the content_repository)?

If so you can turn off archiving using the property above, or reduce the thresholds for how long to hold on to archived data.

If the data is not in the archive folders then it is still deemed to be active in the flow, since multiple flowfiles are bundled together in a content claim, you can have a content claim with some flow files still active and it can't archive the whole thing until they are all no longer in the flow.