detect duplicates processor

[#1]

Hi I tried to remove duplicates

I have a json like below

{

"message":"XXXX",

"id":"1"

}

I want to remove all json with the same id

I try using detect duplicates processor

I try Cashe Entry Identifier ${id} but it's not worked as expected

[#2]

@Matt Burgess I will appricate your support

[#3 · Accepted solution]

If you want to use ${id} as your cache entry identifier, then you need a flow file attribute called id.

You could use EvaluateJsonPath first with an expression of id = $.id to extract the id from the json into an attribute.

[#4]

Thanks @Bryan Bende It's worked for me