Nifi Attribute Limit

[#1]

Hi,

Is there a limit (hard coded or performance) on the number of attributes that can be assigned to a single flowfile?

If not, what are the considerations (e.g. performance, space on disk, etc) for limiting the number of attributes?

Thanks,

[#2 · Accepted solution]

There is no hard-coded limit, but there is definitely some limit in terms of performance. Flow File attributes are held in memory (in addition to being persisted to disk) so more attributes means more Java objects on the heap, means more garbage collection pressure. I don't think there is any way to set what the limit is because it depends on how much data is in the attributes, how much memory you have, how many flow files, etc.