Apache Nifi - use of Notify and Wait with unknown amount of files

Former Member — Fri, 15 May 2020 15:28:13 GMT

I tried to find out on myself, but after days of trying I decided that I need help. My usecase is to concat splitted zip-files (FilaA.zip.001, 002, 003 - 00x) and I don't really know how many files will be delivered. The files are big and delivery takes time... The last file to be delivered is a notification-file "ready.txt"

My current workflow is like this:

- receive alle files

-extract number of zip-file (001-x) and build a priority (999-number of zip-file) of it

-move to a queue with a PriorityAttributePrioritizer

-extract max number of files (i.e. 7 from 007 - the file with priority 992)

-move files via notify processer to the wait processor

- in the wait processor I want to wait until the notfication-file arrived and deliver all the files in wait-queue

-after the the files will be concatenated with the MergeContent processor and unzipped.

My configuration works only one time. ... The second delivery with exact the same filenames as in the first delivery is directly moved to "success" and not into the wait queue...

What I am doing wrong ?

Re: Apache Nifi - use of Notify and Wait with unknown amount of files

Former Member — Fri, 15 May 2020 15:47:19 GMT

I created a new MapCacheService and changed the release condition back to

now it seems to work 🙂

Re: Apache Nifi - use of Notify and Wait with unknown amount of files

cjervis — Wed, 20 May 2020 12:43:34 GMT

I'm happy to see you resolved your issue. Please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future.

question Re: Apache Nifi - use of Notify and Wait with unknown amount of files in Support Questions

Apache Nifi - use of Notify and Wait with unknown amount of files

Re: Apache Nifi - use of Notify and Wait with unknown amount of files

Re: Apache Nifi - use of Notify and Wait with unknown amount of files