We are running spark application and memory usage is increasing continuously after every run. I think it is beacuse of memory leakage. Can you please provide pointers for troubleshooting?
Thanks for posting your query.
I see you have reported your spark application memory usage is getting increased on very run, and you suspect it is because of memory leakage
Could you please share where exactly (Driver,Executor) you are observing memory leakage
This will help us to capture certain diagnostic information
I see from your initial thread that you are seeing Memory leaks on your application. Could you please help us with more details
Like, these messages which you are seeing as a side effect of your GC or memory leak ?
Basically, the error denotes that the zookeeper client connection is getting timed out.
Also, please look for any OutOfMemory or GC Overhead messages or please check from Zookeeper server side as well