Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]

Archives of Support Questions (Read Only)

This is an archived board for historical reference. Information and links may no longer be available or relevant
Announcements
This board is archived and read-only for historical reference. To ask a new question, please post a new topic on the appropriate active board.

Is there any way to keep data globally for all processor that contained in my flow?

avatar
Rising Star

Hello,

I am getting a scenario in my nifi flow in which I will have to keep some data globally in runtime for all processor that contained in my flow, so I can able to get that global data in any processor.

Thankyou

1 ACCEPTED SOLUTION

avatar

@Prakhar Agrawal

Take a look at the DistributedMapCache. It allows you to save flowfile data for consumption by processors across nodes and processors.

There are two controller components, the DistributesMapCacheServer (runs on one node) and the DistricutedMapCacheClient (runs on all nodes if you've got a cluster). There are also the processors that interact with the DistributedMapCache, namely FetchDistributedMapCache and PutDistributedMapCache

Take a look here for some elaboration/documentation:

https://nifi.apache.org/docs.html

https://community.hortonworks.com/questions/35223/distributedmapcacheclientservice-nifi-wecrawlerxml...

Here for examples using DistributedMapCache:

https://github.com/hortonworks-gallery/nifi-templates/tree/master/templates (webcrawler.xml template)

http://funnifi.blogspot.ca/2016/04/

View solution in original post

1 REPLY 1

avatar

@Prakhar Agrawal

Take a look at the DistributedMapCache. It allows you to save flowfile data for consumption by processors across nodes and processors.

There are two controller components, the DistributesMapCacheServer (runs on one node) and the DistricutedMapCacheClient (runs on all nodes if you've got a cluster). There are also the processors that interact with the DistributedMapCache, namely FetchDistributedMapCache and PutDistributedMapCache

Take a look here for some elaboration/documentation:

https://nifi.apache.org/docs.html

https://community.hortonworks.com/questions/35223/distributedmapcacheclientservice-nifi-wecrawlerxml...

Here for examples using DistributedMapCache:

https://github.com/hortonworks-gallery/nifi-templates/tree/master/templates (webcrawler.xml template)

http://funnifi.blogspot.ca/2016/04/