Member since
07-27-2023
55
Posts
19
Kudos Received
1
Solution
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 2518 | 09-14-2023 04:41 AM |
09-21-2023
02:19 AM
Please ignore this question. My understanding of the problem itself was wrong.
... View more
09-21-2023
02:01 AM
I have records with following structure: { field1 : val1 field2: val2 fields3: x::y::z field4: a::b::c ..... } field3 and field4 are basically pairs..ie x is paired with a, y with b, z with c. I want to break this record to reflect above pairing. So it would result in 3 records, with first one having field3 as x and field4 as a, second record having field3 as y and field4 as b and so on. Can it be achieved with nifi dsl?
... View more
Labels:
- Labels:
-
Apache NiFi
09-16-2023
11:47 PM
I am using ListFile processor to pick up input files to my flow. And it picks up all available files in the directory. Is it possible to configure it to pick only one file, let its processing to be completed and then pick next file. So basically only one file at a time to be processed by system. Or if any processor other than ListFile can be used for this purpose?
... View more
Labels:
- Labels:
-
Apache NiFi
09-15-2023
05:40 AM
This served my purpose. ${now():toNumber():minus(${lineageStartDate}):format("HH:mm:ss", "GMT")} I added it to a LogMessage processor, and I can see the result in logs, though sending it over a mail would be terrific.
... View more
09-15-2023
02:58 AM
What is most convenient way of determining total time taken by a group of consecutive processors? Do I need to log time before first and after last processor, and then take the diff? Or there is some inbuild feature that can help me on this?
... View more
Labels:
- Labels:
-
Apache NiFi
09-14-2023
07:28 PM
Its a custom processor, and it reads avro records(using AvroReader) and writes them too(using AvroRecordSetWriter).
... View more
09-14-2023
07:25 PM
Its ListFile.
... View more
09-14-2023
07:24 PM
I used docker copy command.
... View more
09-14-2023
05:16 AM
On a processor, right click -> view status history....there is a data available by name 'Records Processed' in dropdown. For one of the processor in my flow, this is not available. What can be the reason for this? Is it possible that value was so high that system lost track somewhere?
... View more
Labels:
- Labels:
-
Apache NiFi
09-14-2023
04:41 AM
1 Kudo
Got the answer. First processor has listing strategy set to 'Tracking Timestamps', and copied file has older timestamp than the latest tracked one.
... View more