Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]
Created 03-12-2016 11:26 PM
Is there any guide available for NiFi capacity planning ? What load characteristic should be looked at ?
- Number of concurrent processors running
- Total throughput
Any help is greatly appreciated.
Created 03-12-2016 11:32 PM
Created 03-14-2016 08:56 PM
Thank You @mclark This is exactly what I was looking for.
Created 03-16-2016 10:13 PM
The NCM in a NiFi cluster typically needs more heap memory. The number of components (processors, input ports, output ports and relationships) x the number of nodes in the NiFi cluster on the graph will drive how much memory your NCM will need. For ~300 - 400 components and 3 - 4 node cluster, the NCM seems pretty good with 8GB of heap. If you encounter heap issue still, you would need to increase the heap size and/or reduce the stat buffer size and/or frequency in the nifi.properties files (NCM and Nodes).
nifi.components.status.repository.buffer.size=360 (defaults is 1440)
nifi.components.status.snapshot.frequency=5 min (default is 1)
This information is accurate as of NiFi 0.5.1 and HDF 1.1.2.