Support Questions
Find answers, ask questions, and share your expertise
Announcements
Check out our newest addition to the community, the Cloudera Innovation Accelerator group hub.

Nifi queue position duplicated, position not unique

Super Collaborator

I have a NiFi cluster runnig, when i check the queue the positions seem duplicated, there are for instance 3 messages with position 1 and 3 with position 2. The timestamps are similar but not neccesarily the same, and the UUIDs are not duplicated. What is happening?


- Dennis Jaheruddin

If this answer helped, please mark it as 'solved' and/or if it is valuable for future readers please apply 'kudos'. Also check out my techincal portfolio at https://portfolio.jaheruddin.nl
1 REPLY 1

Super Collaborator

The important thing to keep in mind is that NiFi is built for distributed processing. As such, there is essentially one queue per node. The position in the queue is therefore unique within that node, but it is expected that each node will have a message with position 1.

 

Sidenote, it is therefore also expected that if you set a queue size of 10000, you will end up with a queue of size 30000.

 


- Dennis Jaheruddin

If this answer helped, please mark it as 'solved' and/or if it is valuable for future readers please apply 'kudos'. Also check out my techincal portfolio at https://portfolio.jaheruddin.nl