Support Questions

Find answers, ask questions, and share your expertise

Nifi queue position duplicated, position not unique

avatar

I have a NiFi cluster runnig, when i check the queue the positions seem duplicated, there are for instance 3 messages with position 1 and 3 with position 2. The timestamps are similar but not neccesarily the same, and the UUIDs are not duplicated. What is happening?


- Dennis Jaheruddin

If this answer helped, please mark it as 'solved' and/or if it is valuable for future readers please apply 'kudos'.
1 REPLY 1

avatar

The important thing to keep in mind is that NiFi is built for distributed processing. As such, there is essentially one queue per node. The position in the queue is therefore unique within that node, but it is expected that each node will have a message with position 1.

 

Sidenote, it is therefore also expected that if you set a queue size of 10000, you will end up with a queue of size 30000.

 


- Dennis Jaheruddin

If this answer helped, please mark it as 'solved' and/or if it is valuable for future readers please apply 'kudos'.