question NiFi UI showing Flowfile storage and Content Storage showing full in Archives of Support Questions (Read Only)

NiFi UI showing Flowfile storage and Content Storage showing full

dhieru — Thu, 19 Oct 2017 21:03:47 GMT

Hi All,

Thanks

The NiFi UI is showing the content and flow file repository to be used 100% (and set to only 1.91 GB) but in the nifi.properties file it has been configured for 3 TB each.

flowstorage1.png contentstorage.png

Re: NiFi UI showing Flowfile storage and Content Storage showing full

Wynner — Thu, 19 Oct 2017 21:41:54 GMT

@dhieru singh

Please post a snapshot of the section covering content repository configuration in the nifi.properties file. Specifically these properties

# Content Repository

nifi.content.repository.implementation=org.apache.nifi.controller.repository.FileSystemRepository nifi.content.claim.max.appendable.size=10 MB

nifi.content.claim.max.flow.files=100

nifi.content.repository.directory.default=./content_repository

nifi.content.repository.archive.max.retention.period=12 hours

nifi.content.repository.archive.max.usage.percentage=50%

nifi.content.repository.archive.enabled=true nifi.content.repository.always.sync=false

nifi.content.viewer.url=/nifi-content-viewer/

Re: NiFi UI showing Flowfile storage and Content Storage showing full

dhieru — Thu, 19 Oct 2017 22:12:36 GMT

Hi @Wynner

Appreciate your response.contentrepo.png

And the nifi.content.repository.directory.default=/data02/content_repository

Re: NiFi UI showing Flowfile storage and Content Storage showing full

Wynner — Fri, 20 Oct 2017 03:26:47 GMT

@dhieru singh

Is every node configured the same way? There is an inconsistency in what the UI shows and what the snapshot of the disk partition. Will you post a snapshot of the actual nifi.properties files?

Did you change the configuration in the nifi.properties file after initial setup? If so, you will have to restart NiFi for the change to take affect.

FYI, what I do see is that NiFi thinks your content and flow file repos are on the root partition which is full and that is very bad.

Re: NiFi UI showing Flowfile storage and Content Storage showing full

dhieru — Sat, 21 Oct 2017 02:07:11 GMT

@Wynner you were correct the content and flowfile were refering to root, changed it and fixed it by referring content repo to different disk and flow file to different raid/disk

this link also helped me https://community.hortonworks.com/articles/7882/hdfnifi-best-practices-for-setting-up-a-high-perfo.html