Support Questions
Find answers, ask questions, and share your expertise

NiFi application design : maintaining state

Contributor

Hello,

a question regarding application design in NiFi.

 

We have a REST resource which provides data changes since a unix timestamp, which is passed inside a json structure to be sent as http POST.
The major question is how and where to keep the state of the last unix timestamp and how this state is accessible to operation.

We should be able to reset the timestamp to any value to repeat calls. Also we should be able set increment, which es added to the timestmap in the next call.

 

Similary, we have a related issue ina use case, which access a database. We generate a query in GenerateTableFetch and set the property "Maximum-value Columns".
Here the state is maintened by the processor, but it pretty much unclear how to set the state to specific stating value. To clear the state is obviously not appropriate.

 

Best regards
Jaro

1 ACCEPTED SOLUTION

Rising Star

@Jarinek you should check out Distributed Map Cache features of NiFi.  Here is a great post to get started:

 

https://community.cloudera.com/t5/Community-Articles/Working-with-a-NiFi-DistributedMapCache/ta-p/24...

 

 

View solution in original post

2 REPLIES 2

Rising Star

@Jarinek you should check out Distributed Map Cache features of NiFi.  Here is a great post to get started:

 

https://community.cloudera.com/t5/Community-Articles/Working-with-a-NiFi-DistributedMapCache/ta-p/24...

 

 

Community Manager

@Jarinek Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future. If you are still experiencing the issue, can you provide the information @steven-matison has requested? 


Regards,

Diana Torres,
Community Moderator


Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.
Learn more about the Cloudera Community:
Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.