Multi-thread support is provided via the concurrent tasks configuration parameter on a processor. Think of as being able to run multiple copies of the same processor in parallel on the same NiFi instance. Each thread is not tied to one another, so no file chunking occurs here. NiFi works on batches of files to be more efficient, so multiple thread would allow a processors to work on multiple batches at the same time. So in the case of a putSFTP, multiple connections will be established with destination at the same time sending multiple batches of files. If the network bandwidth exists, this can result in a considerable increase in overall throughput.
... View more
