NiFi - Use cases with low bandwidth

[#1]

Does NiFi have any communication protocalls which would help increase performance on network with low bandwidth?

Use case example:

Moving data from FTP server (cali) to data center in New York. Performance is terrible due to bandwidth.

Can NiFi Help? if so how?

[#2]

@Sunile Manjee https://nifi.apache.org/docs.html first few paragraphs

[#3]

Multi-thread support is provided via the concurrent tasks configuration parameter on a processor. Think of as being able to run multiple copies of the same processor in parallel on the same NiFi instance. Each thread is not tied to one another, so no file chunking occurs here. NiFi works on batches of files to be more efficient, so multiple thread would allow a processors to work on multiple batches at the same time. So in the case of a putSFTP, multiple connections will be established with destination at the same time sending multiple batches of files. If the network bandwidth exists, this can result in a considerable increase in overall throughput.

[#4]

@Sunile Manjee there's multiple ways of doing things, you can split a large file into smaller files, I've done that with CSV and split by column types. This is just one way.