Community Articles
Find and share helpful community-sourced technical articles
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.
Labels (1)
Contributor

While designing your flow, one will think of handling failures as well. Some may ignore (terminate) it while some may want to analyze their failed flow files.

You can view/download any flowfile in the connection via NiFi UI. However if there are multiple flowfiles then this becomes little tedious since you have to do it for each flowfile. .

In that case, I used below flow to put all failed flow files to a temp location on my nifi node and then access it from there for further analysis.

  1. In this I am generating random 2B text file and passing it to FTP server.
  2. If FTP server is unreachable it will put all flow files to failure/reject queue.
  3. You can list all files in this queue. I have viewed one such file in image below.
  4. Then all these files are passed to PutFile processor which is configured to write all the files it receives to /tmp/test location on the nifi node.

Please note: There could be multiple ways to do this. This is the approach used by me to quickly download all failed flow files in my flow.

download-failed-flowfiles-2.png

download-failed-flowfiles-3.png

download-failed-flowfiles-4.png

download-failed-flowfiles-5.png

16653-download-failed-flowfiles-6.png

16654-download-failed-flowfiles-7.png

472 Views
Don't have an account?
Coming from Hortonworks? Activate your account here
Version history
Revision #:
2 of 2
Last update:
‎08-17-2019 12:10 PM
Updated by:
 
Contributors
Top Kudoed Authors