Support Questions

Find answers, ask questions, and share your expertise

Nifi sequence

avatar
New Contributor

Hello,
I'm using nifi 1.13.2 in 4 nodes cluster. My flow tries to consumes record from Kafka then map some data and send them to AMQ. I need to keep the order of retrieved records and send them in the same order.

I tried set execution on primary node only for every processor in group. I also set up max.pool.records (ConsumeKafka) and Concurrent tasks to 1. Next i set 1 sec run shedule and it doesn't work. Records are consumed with 10ms delay, not a 1 sec and the sequence is not conserved.

Thanks in advance.

2 REPLIES 2

avatar
New Contributor

I think you should also add number of nodes in your kafka and the partitions for the topic, for a better response.

avatar
New Contributor

3 kafka nodes, 2 partitions for the topic