Support Questions
Find answers, ask questions, and share your expertise

Nifi dataflow performance

Explorer

How can we improve the read/write speed in PublishKfkarecord processor at present it is taking around 5 min to write the data in kafka(around 50lk records).

Can we do this in 1 minute ?And how ?

1 REPLY 1

Hi @hema moger,

You might be interested by http://bryanbende.com/development/2016/09/15/apache-nifi-and-apache-kafka

In particular it'll depend on how much partitions you have in your Kafka topic and you'll be able to set concurrency on NiFi's side accordingly.