Support Questions
Find answers, ask questions, and share your expertise

NiFi Volatile Content Repository out of space

Contributor

Hi guys,

I setup Volatile content repo for my NiFi cluster, the other repos are all file-based.

However, It shows me "Content Repository out of space " exception, when I process only 20M dataset.

It seems below settings don't work.

nifi.content.repository.implementation=org.apache.nifi.controller.repository.VolatileContentRepository

nifi.volatile.content.repository.max.size=1 GB
nifi.volatile.content.repository.block.size=32 KB

From below code comment, I found

" If no Backup Repository has been specified, when the threshold is exceeded, an IOException will be thrown"

https://github.com/apache/nifi/blob/master/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nif...

My questions are:

1. How to setup the Backup Repository for volatile content repository?

2. Is my above setting for "nifi.volatile.content.repository.max.size" correct? It seems still using the default 100MB.

Thanks.

1 REPLY 1

New Contributor

Hi,


nifi.content.repository.implementation=org.apache.nifi.controller.repository.VolatileContentRepository
nifi.volatile.content.repository.max.size=2 GB
nifi.volatile.content.repository.block.size=32 KB

When using the config above, NiFi is unable to process the flow filesand gives error below:

Caused by: java.io.IOException: Content Repository is out of space
at org.apache.nifi.controller.repository.VolatileContentRepository$ContentBlock$ClaimSwitchingOutputStream.redirect(VolatileContentRepository.java:632)

Has anyone had success in using VolatileContentRepository?

Cheers

; ;