NiFi application design : maintaining state

Question

Hello,a question regarding application design in NiFi. We have a REST resource which provides data changes since a unix timestamp, which is passed inside a json structure to be sent as http POST.The major question is how and where to keep the state of the last unix timestamp and how this state is accessible to operation.We should be able to reset the timestamp to any value to repeat calls. Also we should be able set increment, which es added to the timestmap in the next call. Similary, we have a related issue ina use case, which access a database. We generate a query in GenerateTableFetch and set the property "Maximum-value Columns".Here the state is maintened by the processor, but it pretty much unclear how to set the state to specific stating value. To clear the state is obviously not appropriate. Best regardsJaro

steven-matison · Accepted Answer

@Jarinek you should check out Distributed Map Cache features of NiFi. Here is a great post to get started:

https://community.cloudera.com/t5/Community-Articles/Working-with-a-NiFi-DistributedMapCache/ta-p/248370

Sign up

Please use your Cloudera account.

Login to the community

Please use your Cloudera account.