Member since
04-05-2021
5
Posts
0
Kudos Received
0
Solutions
04-13-2021
12:47 AM
Thanks. We have decided to introduce Priority attribute & use the corresponding prioritizer for the connection.
... View more
04-09-2021
01:59 AM
In your case, you have a custom processor that takes in 1 FlowFile and may output 1 or more FlowFiles. Are all output FlowFiles created as new? Yes. we are creating new flow files for input flow file. Processor A get triggered with single flow file which comes to it scheduled intervals. After getting this request, the processor reads the data from source like DB & produces output flow files for each 100 records from source which sent to processor B for writing in SFTP. In Processor B we are observing FFs going out of order.
... View more
04-06-2021
11:50 PM
Hi , This typically varies & we can seen it can be around 100ms(best case) - 2 seconds(worst case) range. Avg is around 200-300ms
... View more
04-05-2021
06:42 AM
Thanks. We haven't explicitly setup an prioritizer so far the connection. Now observing it goes out of order at random times. So looking for best prioritizer which will help us to maintain the order, confused between the two FIFO & oldestFlowFile.
... View more
04-05-2021
03:48 AM
Hi, We need help with respect to order of records in Nifi. We have couple of custom processors which work in batch. There is processor which reads the data from source (Processor A) & another processor which writes the data to SFTP (processor B). Processor A outputs the data in form of multiple flow files (100 records from source are written in one flow file). Assume if there are 600 records in source, we get 6 FFs out of processor A. Process A & Processor B are directly connected to each other & entire execution happens in Single node only. However, we are finding that one some occasions the Process B is processing flow files out of order. For example, third flow gets processed first & then the second flow file. Understood the flow fill prioritizer needs to be chosen explicitly in the connection between Process A & Process B. However, confused up on FirstInFirstOut prioritizer & OlderFlowFilePrioritizer. Kindly provide pointers to guarantee the order of flow files Thanks in advance.
... View more
Labels:
- Labels:
-
Apache NiFi