Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

NiFi UI showing Flowfile storage and Content Storage showing full

Solved Go to solution

NiFi UI showing Flowfile storage and Content Storage showing full

Contributor

Hi All,

Thanks

The NiFi UI is showing the content and flow file repository to be used 100% (and set to only 1.91 GB) but in the nifi.properties file it has been configured for 3 TB each.

flowstorage1.pngcontentstorage.png

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted

Re: NiFi UI showing Flowfile storage and Content Storage showing full

@dhieru singh

Is every node configured the same way? There is an inconsistency in what the UI shows and what the snapshot of the disk partition. Will you post a snapshot of the actual nifi.properties files?

Did you change the configuration in the nifi.properties file after initial setup? If so, you will have to restart NiFi for the change to take affect.

FYI, what I do see is that NiFi thinks your content and flow file repos are on the root partition which is full and that is very bad.

View solution in original post

4 REPLIES 4
Highlighted

Re: NiFi UI showing Flowfile storage and Content Storage showing full

@dhieru singh

Please post a snapshot of the section covering content repository configuration in the nifi.properties file. Specifically these properties

# Content Repository

nifi.content.repository.implementation=org.apache.nifi.controller.repository.FileSystemRepository nifi.content.claim.max.appendable.size=10 MB

nifi.content.claim.max.flow.files=100

nifi.content.repository.directory.default=./content_repository

nifi.content.repository.archive.max.retention.period=12 hours

nifi.content.repository.archive.max.usage.percentage=50%

nifi.content.repository.archive.enabled=true nifi.content.repository.always.sync=false

nifi.content.viewer.url=/nifi-content-viewer/

Highlighted

Re: NiFi UI showing Flowfile storage and Content Storage showing full

Contributor

Hi @Wynner

Appreciate your response.contentrepo.png

And the nifi.content.repository.directory.default=/data02/content_repository

Highlighted

Re: NiFi UI showing Flowfile storage and Content Storage showing full

@dhieru singh

Is every node configured the same way? There is an inconsistency in what the UI shows and what the snapshot of the disk partition. Will you post a snapshot of the actual nifi.properties files?

Did you change the configuration in the nifi.properties file after initial setup? If so, you will have to restart NiFi for the change to take affect.

FYI, what I do see is that NiFi thinks your content and flow file repos are on the root partition which is full and that is very bad.

View solution in original post

Highlighted

Re: NiFi UI showing Flowfile storage and Content Storage showing full

Contributor

@Wynner you were correct the content and flowfile were refering to root, changed it and fixed it by referring content repo to different disk and flow file to different raid/disk

  1. this link also helped me https://community.hortonworks.com/articles/7882/hdfnifi-best-practices-for-setting-up-a-high-perfo.h...
Don't have an account?
Coming from Hortonworks? Activate your account here