Support Questions
Find answers, ask questions, and share your expertise

Load terabytes of data from Local system to HDFS using Apache Nifi

Rising Star

I am new in Apache NiFi. Do you have any case study to load 1 tb data from Local system to HDFS using Apache Nifi?

1 REPLY 1

Super Collaborator
I have seen NiFi do a terabyte per second when scaled up, so moving a terabyte should not be a problem. It ships with standard processors to listen to a folder, and to store in HDFS. Most likely the bottleneck will not be in NiFi but in your network.

- Dennis Jaheruddin

If this answer helped, please mark it as 'solved' and/or if it is valuable for future readers please apply 'kudos'. Also check out my techincal portfolio at https://portfolio.jaheruddin.nl