Member since
09-13-2017
20
Posts
0
Kudos Received
0
Solutions
10-03-2017
11:17 PM
1 Kudo
Setting concurrent tasks to 10 will give the processor the ability to request up to 10 threads from the NiFi controller, so that 10 flowfiles can be processed concurrently. However, since you have NiFi running on a single node, an individual flowfile will not be processed in parallel - i.e. - subsets of the flowfile's data are not processed independently in parallel. If you have NiFi running in a cluster with more than 1 node, the data can be divided among the nodes and processed in parallel.
... View more
10-02-2017
07:12 PM
@John Carter Would you accept the answer so that others know it resolved your issue?
... View more
10-17-2017
04:47 PM
@John Carter, It will depend on kind of latency, processing, and data volume you will be handling. Both are different approaches. Sqoop as you know will run mapreduce jobs while Nifi use case will be on streaming side. Given right resources both will work.
... View more
09-18-2017
03:27 AM
Hi, Could you please let me know how the resetting of target signal count in wait processor work? Refer my question: https://community.hortonworks.com/questions/138762/reset-of-target-signal-count-in-wait-processor.html Thanks, John
... View more