Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Nifi sequence

avatar
New Contributor

Hello,
I'm using nifi 1.13.2 in 4 nodes cluster. My flow tries to consumes record from Kafka then map some data and send them to AMQ. I need to keep the order of retrieved records and send them in the same order.

I tried set execution on primary node only for every processor in group. I also set up max.pool.records (ConsumeKafka) and Concurrent tasks to 1. Next i set 1 sec run shedule and it doesn't work. Records are consumed with 10ms delay, not a 1 sec and the sequence is not conserved.

Thanks in advance.

2 REPLIES 2

avatar
New Contributor

I think you should also add number of nodes in your kafka and the partitions for the topic, for a better response.

avatar
New Contributor

3 kafka nodes, 2 partitions for the topic