question How does NiFi support parallel processing of messages ? Also do we have the threading configuration at processor level ? Does the Nifi flow setting applicable to entire NiFi instance? in Support Questions

How does NiFi support parallel processing of messages ? Also do we have the threading configuration at processor level ? Does the Nifi flow setting applicable to entire NiFi instance?

mpandit — Thu, 16 Jun 2016 22:59:17 GMT

Re: How does NiFi support parallel processing of messages ? Also do we have the threading configuration at processor level ? Does the Nifi flow setting applicable to entire NiFi instance?

TimothySpann — Fri, 17 Jun 2016 21:22:47 GMT

Define parallel processing.

You have many nodes for ingest.

https://nifi.apache.org/docs/nifi-docs/html/user-guide.html

Event driven: When this mode is selected, the Processor will be triggered to run by an event, and that event occurs when FlowFiles enter Connections feeding this Processor. This mode is currently considered experimental and is not supported by all Processors. When this mode is selected, the ‘Run schedule’ option is not configurable, as the Processor is not triggered to run periodically but as the result of an event. Additionally, this is the only mode for which the ‘Concurrent tasks’ option can be set to 0. In this case, the number of threads is limited only by the size of the Event-Driven Thread Pool that the administrator has configured.

Re: How does NiFi support parallel processing of messages ? Also do we have the threading configuration at processor level ? Does the Nifi flow setting applicable to entire NiFi instance?

tarek_elgamal — Fri, 20 Oct 2017 13:18:12 GMT

Thanks @Timothy Spann for this answer, I was wondering which parameter in the nifi propertiescontrols size of the Event Driven Thread Pool ?