Member since
07-27-2023
55
Posts
19
Kudos Received
1
Solution
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 3012 | 09-14-2023 04:41 AM |
10-06-2023
04:42 AM
I have a usecase which involves creating a new Record(actually several records) from a record in input flowfile, and writing it in output flowfile. PS: I would use avro reader to read input and avro writer to write into output. What is idiomatic way of doing it in nifi?
... View more
Labels:
- Labels:
-
Apache NiFi
09-27-2023
07:57 PM
Got it. Its on Data Provenance dialog box.
... View more
09-27-2023
07:52 PM
Where is this graph available on ui? And does it get updated after every run?
... View more
09-27-2023
02:36 AM
I have a nifi flow. I observe that if input file is split into smaller files and fed into the flow one by one, then overall time taken(sum of time taken for individual files) is considerably low compared to when I feed single big file. What can be a possible cause for this performance difference? Note: Flow has many processors that use avro readers/writers. I calculate time using following in a LogMessage processor: ${now():toNumber():minus(${lineageStartDate}):format("HH:mm:ss", "GMT")}
... View more
Labels:
- Labels:
-
Apache NiFi
09-16-2023
11:47 PM
I am using ListFile processor to pick up input files to my flow. And it picks up all available files in the directory. Is it possible to configure it to pick only one file, let its processing to be completed and then pick next file. So basically only one file at a time to be processed by system. Or if any processor other than ListFile can be used for this purpose?
... View more
Labels:
- Labels:
-
Apache NiFi
09-14-2023
07:28 PM
Its a custom processor, and it reads avro records(using AvroReader) and writes them too(using AvroRecordSetWriter).
... View more
09-14-2023
07:25 PM
Its ListFile.
... View more
09-14-2023
07:24 PM
I used docker copy command.
... View more
09-14-2023
05:16 AM
On a processor, right click -> view status history....there is a data available by name 'Records Processed' in dropdown. For one of the processor in my flow, this is not available. What can be the reason for this? Is it possible that value was so high that system lost track somewhere?
... View more
Labels:
- Labels:
-
Apache NiFi
09-14-2023
04:41 AM
1 Kudo
Got the answer. First processor has listing strategy set to 'Tracking Timestamps', and copied file has older timestamp than the latest tracked one.
... View more