Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

NiFi Remove duplicates Error

NiFi Remove duplicates Error

Explorer

I encountered the following run-time error using NiFi at a Remove-duplicates processor.

Can anybody tell what's wrong and the possible causes for this?

-----------------------------------------------------------------------------------------------------------------------------

18:05:37 ESt - hostname:9090 - ERROR

DetectDuplicate[id=2345438...534213134] Unable to communicate with cache when processing

StandardFlowFileRecord[uuid=ae375a5a...40fdf9, claim=StandardContentClaim

[resourceClaim=StandardResourceClaim[id=1498208137037-7, container=default, sectin=7, offset=116400, length=26691],

offset=25782,name=SeedURL,size=247]

due to java.net.ConnectException: Connection was refused

java.net.ConnectException: Connection was refused

-----------------------------------------------------------------------------------------------------------------------------

3 REPLIES 3
Highlighted

Re: NiFi Remove duplicates Error

@Yu Song

It looks like the processor couldn't communicate with the Distribute Cache Service controller service it uses for detecting duplicates.

Does this error occur often?

Highlighted

Re: NiFi Remove duplicates Error

Super Guru

Did you configure a DistributedMapCacheClient but not a DistributedMapCacheServer for it to connect to?

Highlighted

Re: NiFi Remove duplicates Error

Explorer

@Wynner

it doesn't happen right away but once it occurs the error stays there for a few moments.

we can just ignore it and let it go?

Don't have an account?
Coming from Hortonworks? Activate your account here