question Re: How to ignore/filter flow-files on the base of attributes in Nifi in Support Questions

How to ignore/filter flow-files on the base of attributes in Nifi

obaid_salikeen — Fri, 23 Sep 2016 00:25:42 GMT

Hi,

I have a scenario where I want to ignore flow files if an attribute of a flowfile contains invalid value (like filename contains invalid value i.e name of a directory rather then a filename)

Is there a way to totally discard/ignore a FlowFile on the base of an attribute value?

Thanks

Obaid

Re: How to ignore/filter flow-files on the base of attributes in Nifi

mburgess — Fri, 23 Sep 2016 00:29:35 GMT

The RouteOnAttribute processor is what you're looking for, you can match on an attribute value (for example), and only route to a "matched" relationship; self-terminating the "unmatched" relationship would cause the FlowFile to be discarded/ignored. Also if you want to do any error handling you could route unmatched flow files to another processor to log or otherwise handle them.

Re: How to ignore/filter flow-files on the base of attributes in Nifi

pvillard — Fri, 23 Sep 2016 00:32:08 GMT

I'd add as a comment to Matt's answer that you can check the content of your attributes using the expression language [1]. It provides a lot of functions to deal with attributes and apply conditions to route your flow files if and only if they respect the conditions you want.

[1] https://nifi.apache.org/docs/nifi-docs/html/expression-language-guide.html

Re: How to ignore/filter flow-files on the base of attributes in Nifi

obaid_salikeen — Fri, 23 Sep 2016 00:34:26 GMT

Thanks a lot @Matt Burgess and @Pierre Villard for a quick response,

Re: How to ignore/filter flow-files on the base of attributes in Nifi

j_rodriguez — Thu, 07 Sep 2017 20:11:48 GMT

Hello,

Is it possible to compare the attributes of two different flowfiles and only pass one if the comparisson results matched?

Thank you,

Jon

Re: How to ignore/filter flow-files on the base of attributes in Nifi

Wynner — Fri, 08 Sep 2017 02:17:44 GMT

@Jon Rodriguez Breton

This should be a new question in HCC, not appended to your first question.

Re: How to ignore/filter flow-files on the base of attributes in Nifi

j_rodriguez — Fri, 08 Sep 2017 14:19:47 GMT

Hi,

New question added here:

https://community.hortonworks.com/questions/135939/compare-attributes-of-different-flowfiles.html

Hope you can help me.

Jon