Created on 06-14-2017 10:48 AM - edited 09-16-2022 04:45 AM
Hello,
I am getting a scenario in my nifi flow in which I will have to keep some data globally in runtime for all processor that contained in my flow, so I can able to get that global data in any processor.
Thankyou
Created 06-14-2017 11:22 AM
Take a look at the DistributedMapCache. It allows you to save flowfile data for consumption by processors across nodes and processors.
There are two controller components, the DistributesMapCacheServer (runs on one node) and the DistricutedMapCacheClient (runs on all nodes if you've got a cluster). There are also the processors that interact with the DistributedMapCache, namely FetchDistributedMapCache and PutDistributedMapCache
Take a look here for some elaboration/documentation:
https://nifi.apache.org/docs.html
Here for examples using DistributedMapCache:
https://github.com/hortonworks-gallery/nifi-templates/tree/master/templates (webcrawler.xml template)
Created 06-14-2017 11:22 AM
Take a look at the DistributedMapCache. It allows you to save flowfile data for consumption by processors across nodes and processors.
There are two controller components, the DistributesMapCacheServer (runs on one node) and the DistricutedMapCacheClient (runs on all nodes if you've got a cluster). There are also the processors that interact with the DistributedMapCache, namely FetchDistributedMapCache and PutDistributedMapCache
Take a look here for some elaboration/documentation:
https://nifi.apache.org/docs.html
Here for examples using DistributedMapCache:
https://github.com/hortonworks-gallery/nifi-templates/tree/master/templates (webcrawler.xml template)