Reply
Highlighted
New Contributor
Posts: 3
Registered: ‎06-24-2016

Spark Streaming Association Error

Hi 

 

I can see following error frequently in logs. Can it cause any data loss issues? Should we just ignore this error?

 

2016-06-24 16:41:58,199 ERROR [YarnScheduler] Lost executor 51 on tm1vmwrkl003.echostar.com: remote Rpc client disassociated
2016-06-24 16:41:58,204 ERROR [ErrorMonitor] AssociationError [akka.tcp://sparkDriver@10.18.95.35:49078] -> [akka.tcp://sparkExecutor@tm1vmwrkl003.echostar.com:40179]: Error [Association failed with [akka.tcp://sparkExecutor@tm1vmwrkl003.echostar.com:40179]] [
akka.remote.EndpointAssociationException: Association failed with [akka.tcp://sparkExecutor@tm1vmwrkl003.echostar.com:40179]
Caused by: akka.remote.transport.netty.NettyTransport$$anonfun$associate$1$$anon$2: Connection refused: tm1vmwrkl003.echostar.com/10.18.95.26:40179
]
akka.event.Logging$Error$NoCause$
2016-06-24 16:41:58,208 ERROR [ErrorMonitor] AssociationError [akka.tcp://sparkDriver@10.18.95.35:49078] -> [akka.tcp://sparkExecutor@tm1vmwrkl003.echostar.com:40179]: Error [Association failed with [akka.tcp://sparkExecutor@tm1vmwrkl003.echostar.com:40179]] [
akka.remote.EndpointAssociationException: Association failed with [akka.tcp://sparkExecutor@tm1vmwrkl003.echostar.com:40179]
Caused by: akka.remote.transport.netty.NettyTransport$$anonfun$associate$1$$anon$2: Connection refused: tm1vmwrkl003.echostar.com/10.18.95.26:40179
]