Support Questions

Find answers, ask questions, and share your expertise

NiFi UI showing Flowfile storage and Content Storage showing full

Contributor

Hi All,

Thanks

The NiFi UI is showing the content and flow file repository to be used 100% (and set to only 1.91 GB) but in the nifi.properties file it has been configured for 3 TB each.

flowstorage1.pngcontentstorage.png

1 ACCEPTED SOLUTION

@dhieru singh

Is every node configured the same way? There is an inconsistency in what the UI shows and what the snapshot of the disk partition. Will you post a snapshot of the actual nifi.properties files?

Did you change the configuration in the nifi.properties file after initial setup? If so, you will have to restart NiFi for the change to take affect.

FYI, what I do see is that NiFi thinks your content and flow file repos are on the root partition which is full and that is very bad.

View solution in original post

4 REPLIES 4

@dhieru singh

Please post a snapshot of the section covering content repository configuration in the nifi.properties file. Specifically these properties

# Content Repository

nifi.content.repository.implementation=org.apache.nifi.controller.repository.FileSystemRepository nifi.content.claim.max.appendable.size=10 MB

nifi.content.claim.max.flow.files=100

nifi.content.repository.directory.default=./content_repository

nifi.content.repository.archive.max.retention.period=12 hours

nifi.content.repository.archive.max.usage.percentage=50%

nifi.content.repository.archive.enabled=true nifi.content.repository.always.sync=false

nifi.content.viewer.url=/nifi-content-viewer/

Contributor

Hi @Wynner

Appreciate your response.contentrepo.png

And the nifi.content.repository.directory.default=/data02/content_repository

@dhieru singh

Is every node configured the same way? There is an inconsistency in what the UI shows and what the snapshot of the disk partition. Will you post a snapshot of the actual nifi.properties files?

Did you change the configuration in the nifi.properties file after initial setup? If so, you will have to restart NiFi for the change to take affect.

FYI, what I do see is that NiFi thinks your content and flow file repos are on the root partition which is full and that is very bad.

Contributor

@Wynner you were correct the content and flowfile were refering to root, changed it and fixed it by referring content repo to different disk and flow file to different raid/disk

  1. this link also helped me https://community.hortonworks.com/articles/7882/hdfnifi-best-practices-for-setting-up-a-high-perfo.h...
Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.