Nifi sizing

[#1]

What size Nifi system would we need to read 400 MB/s from a Kafka topic and store the output in HDFS ? The input is log lines, 100 B to 1KB in length each.

[#2 · Accepted solution]

JP, go for 2-3 typical enterprise-class servers to meet these numbers. Rough starting point is around 200MB/s per node.