question Re: detect duplicates processor in Archives of Support Questions (Read Only)

detect duplicates processor

mohamed_emadald — Wed, 29 Nov 2017 19:31:14 GMT

Hi I tried to remove duplicates

I have a json like below

{

"message":"XXXX",

"id":"1"

}

I want to remove all json with the same id

I try using detect duplicates processor

I try Cashe Entry Identifier ${id} but it's not worked as expected

mohamed_emadald — Wed, 29 Nov 2017 19:50:40 GMT

@Matt Burgess I will appricate your support

bbende — Wed, 29 Nov 2017 22:36:18 GMT

If you want to use ${id} as your cache entry identifier, then you need a flow file attribute called id.

You could use EvaluateJsonPath first with an expression of id = $.id to extract the id from the json into an attribute.

mohamed_emadald — Sun, 03 Dec 2017 19:31:17 GMT

Thanks @Bryan Bende It's worked for me