DetectDuplicate is not working

Question

hello everyone ....please help me out ...i m working on one system that system received alarm from client ...we generally received 10000 alarm ......we want to configure our web with nifi for some other update in alarm ...for this we have used invoked http processor that get all the alarm from web app and then we used split json processor that split one alarm in one flowfile then we used evaluate jsonpath that extract id attribute which will be use in detectduplicate processor ....actually the invoked http processor give repeated alarm but we want only one copy of one alarm ...every 10 min the http processor get alarm from web app but those alarm should not be duplicate ....is it possible to do this .....if you have any other option for this work please suggest me.

and in detectduplicate ----

CacheEntryIndentifier - ${id}

age of duration - 15 min

distributed cache service - DistributedMapCacheClientService

and one more thing i have used DistributedMapCacheClientService --

server hostname - localhost

server port - 4557

thanks in advance

stevenmatison · Accepted Answer

@renuu The solution you are looking for is to add the DistributedMapCacheServer from the controller services tab. Set this to the same port as the DisitributedMapCachClient. Enable. Test flow again.

If this answer resolves your issue or allows you to move forward, please choose to ACCEPT this solution and close this topic. If you have further dialogue on this topic please comment here or feel free to private message me. If you have new questions related to your Use Case please create separate topic and feel free to tag me in your post.

Thanks,

Steven @ DFHZ

Sign up

Please use your Cloudera account.

Login to the community

Please use your Cloudera account.