Nifi : putHDFS losing Data

[#1]

Hi All,

When putHdfs Process with Data what happen if the Nifi node crash or if fail to write to HDFS ?

It is possible to rerun a specific flowfile ?

Regards

[#2 · Accepted solution]

If it failed to write the data to HDFS it would transfer the flow file to the failed relationship, which you route back to itself to keep re-trying, or route to whatever you want to do to handle the error.

If the NiFi node crashed while it was in process of writing the data, but hadn't committed the session in the processor, then when the node restarts that flow file will still be in the queue before the processor and will be tried again.

There should not be data loss.

[#3]

Thanks. It is very clear.