question Re: Nifi consuming all available disk in Archives of Support Questions (Read Only)

Nifi consuming all available disk

bruno1 — Fri, 16 Sep 2022 13:33:27 GMT

I have some processes that search on a SQL base and play to a queue.

In the queue I have limited the size to 100mb and the amount to 10, but even so the NiFi ignores and allocates everything at once, generating a queue of more than 80GB.

I'm running on a cluster with 4 VMs in VMWare with 8GB Ram and 50GB HD Anyone have any idea what's wrong?

Re: Nifi consuming all available disk

krishna11 — Tue, 07 Aug 2018 02:03:50 GMT

Hi Bruno,

Look

https://community.hortonworks.com/content/kbentry/7882/hdfnifi-best-practices-for-setting-up-a-high-perfo.html

Re: Nifi consuming all available disk

bruno1 — Tue, 07 Aug 2018 02:04:28 GMT

The goal was an initial setup, my query brought the data all at once, I should have paged the query and increased the processor delay before.

Re: Nifi consuming all available disk

krishna11 — Tue, 07 Aug 2018 02:20:40 GMT

Look

https://community.hortonworks.com/content/kbentry/82308/understanding-how-nifis-content-repository-archivi.html