After launching pyspark, I'm occasionally seeing an exception that's being print on my pyspark shell -
File "/usr/lib64/python2.7/SocketServer.py", line 295, in _handle_request_noblock
self.process_request(request, client_address)
File "/usr/lib64/python2.7/SocketServer.py", line 321, in process_request
self.finish_request(request, client_address)
File "/usr/lib64/python2.7/SocketServer.py", line 334, in finish_request
self.RequestHandlerClass(request, client_address, self)
File "/usr/lib64/python2.7/SocketServer.py", line 649, in __init__
self.handle()
File "/data0/cloudera/parcels/CDH-6.1.1-1.cdh6.1.1.p0.875250/lib/spark/python/pyspark/accumulators.py", line 266, in handle
poll(authenticate_and_accum_updates)
File "/data0/cloudera/parcels/CDH-6.1.1-1.cdh6.1.1.p0.875250/lib/spark/python/pyspark/accumulators.py", line 241, in poll
if func():
File "/data0/cloudera/parcels/CDH-6.1.1-1.cdh6.1.1.p0.875250/lib/spark/python/pyspark/accumulators.py", line 263, in authenticate_and_accum_updates
"The value of the provided token to the AccumulatorServer is not correct.")
Exception: The value of the provided token to the AccumulatorServer is not correct.
However, when i hit Enter key, it prompts for input and I can execute a command.
Not sure why it's printing the exception though? Any turnarounds for the issue?