Load terabytes of data from Local system to HDFS using Apache Nifi

[#1]

I am new in Apache NiFi. Do you have any case study to load 1 tb data from Local system to HDFS using Apache Nifi?

[#2 · Accepted solution]

Hi @Rajib Mandal,

There is no issue at loading large volumes of data using Apache NiFi. Of course, depending of the characteristics of your setup and of your input files, the performance may change. From what you described, a simple flow with List/FetchFile processors and PutHDFS processor should perform as expected.

Hope this helps.