Support Questions
Find answers, ask questions, and share your expertise

Data stuck in PutHDFS failure loop in Nifi

Rising Star

20504-screen-shot-2017-07-19-at-103209-am.png

Hello, we currently have a setup where we have data being processed in Nifi and then filtered into different folders based hour, one file per folder. We accomplish them by using the append option in Conflict Resolution Strategy of PutHDFS. We also have a cluster of two Nifi nodes and so we have seen before an error where PutHDFS is trying to write to a file and the its current lease holder is the other node so it goes into the failure loop. Well, previously, it would sit there in the failure loop for a bit then get processed. Now, it seems the data is sitting in the failure loop and no being processed. Can anyone think of a reason why this would be occurring?

Here is the settings for PutHDFS:

And the flow:

20503-screen-shot-2017-07-19-at-103239-am.png

0 REPLIES 0