Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Spark Streaming Association Error

Spark Streaming Association Error

New Contributor

Hi 

 

I can see following error frequently in logs. Can it cause any data loss issues? Should we just ignore this error?

 

2016-06-24 16:41:58,199 ERROR [YarnScheduler] Lost executor 51 on tm1vmwrkl003.echostar.com: remote Rpc client disassociated
2016-06-24 16:41:58,204 ERROR [ErrorMonitor] AssociationError [akka.tcp://sparkDriver@10.18.95.35:49078] -> [akka.tcp://sparkExecutor@tm1vmwrkl003.echostar.com:40179]: Error [Association failed with [akka.tcp://sparkExecutor@tm1vmwrkl003.echostar.com:40179]] [
akka.remote.EndpointAssociationException: Association failed with [akka.tcp://sparkExecutor@tm1vmwrkl003.echostar.com:40179]
Caused by: akka.remote.transport.netty.NettyTransport$$anonfun$associate$1$$anon$2: Connection refused: tm1vmwrkl003.echostar.com/10.18.95.26:40179
]
akka.event.Logging$Error$NoCause$
2016-06-24 16:41:58,208 ERROR [ErrorMonitor] AssociationError [akka.tcp://sparkDriver@10.18.95.35:49078] -> [akka.tcp://sparkExecutor@tm1vmwrkl003.echostar.com:40179]: Error [Association failed with [akka.tcp://sparkExecutor@tm1vmwrkl003.echostar.com:40179]] [
akka.remote.EndpointAssociationException: Association failed with [akka.tcp://sparkExecutor@tm1vmwrkl003.echostar.com:40179]
Caused by: akka.remote.transport.netty.NettyTransport$$anonfun$associate$1$$anon$2: Connection refused: tm1vmwrkl003.echostar.com/10.18.95.26:40179
]