Archives of Support Questions (Read Only)

This is an archived board for historical reference. Information and links may no longer be available or relevant
Announcements
This board is archived and read-only for historical reference. To ask a new question, please post a new topic on the appropriate active board.

How to ignore/filter flow-files on the base of attributes in Nifi

avatar
Expert Contributor

Hi,

I have a scenario where I want to ignore flow files if an attribute of a flowfile contains invalid value (like filename contains invalid value i.e name of a directory rather then a filename)

Is there a way to totally discard/ignore a FlowFile on the base of an attribute value?

Thanks

Obaid

1 ACCEPTED SOLUTION

avatar
Master Guru

The RouteOnAttribute processor is what you're looking for, you can match on an attribute value (for example), and only route to a "matched" relationship; self-terminating the "unmatched" relationship would cause the FlowFile to be discarded/ignored. Also if you want to do any error handling you could route unmatched flow files to another processor to log or otherwise handle them.

View solution in original post

6 REPLIES 6

avatar
Master Guru

The RouteOnAttribute processor is what you're looking for, you can match on an attribute value (for example), and only route to a "matched" relationship; self-terminating the "unmatched" relationship would cause the FlowFile to be discarded/ignored. Also if you want to do any error handling you could route unmatched flow files to another processor to log or otherwise handle them.

avatar

I'd add as a comment to Matt's answer that you can check the content of your attributes using the expression language [1]. It provides a lot of functions to deal with attributes and apply conditions to route your flow files if and only if they respect the conditions you want.

[1] https://nifi.apache.org/docs/nifi-docs/html/expression-language-guide.html

avatar
Expert Contributor

Thanks a lot @Matt Burgess and @Pierre Villard for a quick response,

avatar
New Member

Hello,

Is it possible to compare the attributes of two different flowfiles and only pass one if the comparisson results matched?

Thank you,

Jon

avatar
@Jon Rodriguez Breton

This should be a new question in HCC, not appended to your first question.

avatar
New Member