Support Questions

Find answers, ask questions, and share your expertise
Announcements
Share your experience with Cloudera on G2 and get a $25 Amazon Gift card.

Need to restart Nifi 1.13.2 to clean content repository

avatar
Visitor

Dear all,

 

After migrating an historical flow from 1.11.4 to 1.13.2, without any changes, after a while, the limits are raised but the content repository is never cleaned. I restart nifi, and the content-repository is cleaned.

 

Thx for your help

Jean-Louis

 

OS : Ubuntu : 20.04.2

Java : OpenJDK Runtime Environment (build 1.8.0_292-8u292-b10-0ubuntu1~20.04-b10)

Nifi properties:

 

# Content Repository
nifi.content.repository.implementation=org.apache.nifi.controller.repository.FileSystemRepository
nifi.content.claim.max.appendable.size=10 MB
nifi.content.claim.max.flow.files=100
nifi.content.repository.directory.default=/data3/nifi_repositories/content_repository
nifi.content.repository.archive.max.retention.period=12 hours
nifi.content.repository.archive.max.usage.percentage=50%
nifi.content.repository.archive.enabled=true
nifi.content.repository.always.sync=false
nifi.content.viewer.url=/nifi-content-viewer/
nifi.content.repository.encryption.key.provider.implementation=
.

 

1 ACCEPTED SOLUTION

avatar
Visitor

I think I figured out with this issue.

I deal with very small and very huge contents, the default values for properties hereafter are not appropriate (Claim size retained ...), so I decrease drastically the values as follows:

  • nifi.content.claim.max.appendable.size=10 MB   ==> 5MB
  • nifi.content.claim.max.flow.files=100 ==> 50
  • nifi.content.repository.archive.max.retention.period=12 hours ==> 2 hours

Until now, the platform doesn't freeze anymore.

Jean-Louis

View solution in original post

1 REPLY 1

avatar
Visitor

I think I figured out with this issue.

I deal with very small and very huge contents, the default values for properties hereafter are not appropriate (Claim size retained ...), so I decrease drastically the values as follows:

  • nifi.content.claim.max.appendable.size=10 MB   ==> 5MB
  • nifi.content.claim.max.flow.files=100 ==> 50
  • nifi.content.repository.archive.max.retention.period=12 hours ==> 2 hours

Until now, the platform doesn't freeze anymore.

Jean-Louis