Member since
07-27-2023
55
Posts
19
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1333 | 09-14-2023 04:41 AM |
09-14-2023
07:24 PM
I used docker copy command.
... View more
09-14-2023
05:16 AM
On a processor, right click -> view status history....there is a data available by name 'Records Processed' in dropdown. For one of the processor in my flow, this is not available. What can be the reason for this? Is it possible that value was so high that system lost track somewhere?
... View more
Labels:
- Labels:
-
Apache NiFi
09-14-2023
04:41 AM
1 Kudo
Got the answer. First processor has listing strategy set to 'Tracking Timestamps', and copied file has older timestamp than the latest tracked one.
... View more
09-14-2023
04:21 AM
I have a nifi flow, working fine. It picks file from a source directory, processes it, and file is deleted from source directory once picked up. This all works fine first time. But later on, if I copy another file in source directory, that file is not picked up. I even stop all processors, clean any queue if not empty, and restart processors, but still file is not picked from input directory. What causes this behaviour? As a result, I have to stop-restart nifi, making it a bit cumbersome. PS: Based on some google suggestions, I tried to delete flowfile_repository, but it doesn't allow so with message 'Device or resource busy'.
... View more
Labels:
- Labels:
-
Apache NiFi
09-12-2023
07:23 PM
So basically all nodes perform exactly entire task. There is no divide and rule by default. Flow designer has to introduce any such parallelism by herself.
... View more
09-11-2023
09:42 PM
I have some basic questions about nifi cluster. I understand that nifi makes use of multiple nodes to speed up the processing of data. But how do we ensure durability of data processed? Suppose we distribute n flowfiles in a queue to several nodes, with each node getting a subset of n files. Does nifi assign same subset to more than one nodes, so that if one of those processing node goes down, we still have others working on same subset? Second, how is result of processing done on different nodes aggregated? Is it done on primary node OR there is some other mechanism?
... View more
Labels:
- Labels:
-
Apache NiFi
09-10-2023
11:45 PM
@SAMSAL I experimented same template with nifi 1.10.0, and found that FetchXMLFile has no issues with execution node as PRIMARY. It seems this new requirement mentioned by you was introduced only after 1.10.0.
... View more
09-08-2023
05:02 AM
What does this message mean on an invalid processor: I see it for processor FetchXMLFile. On scheduling tab, execution dropdown has 'Primary Node' selected. On changing it to 'All Nodes', error goes away. I am on 1.22.0(with some nars from 1.10.0 also added to lib folder).
... View more
Labels:
- Labels:
-
Apache NiFi
09-07-2023
07:30 PM
So I copied only those nars which we use, and container could launch now. Though I have to remove few nars which were causing issues, like nifi-ssl-context-service-nar-1.10.0.nar. And now existing flows dont have issues with properties which are obsolete in 1.22.0 as 1.10.0 nars are used for those components. Thanks for all the inputs.
... View more
09-06-2023
08:02 AM
Ok. So I would need to copy them one by one and check if container launches. It would be lot of work I guess.
... View more
- « Previous
- Next »