Hello All,
We are running spark application and memory usage is increasing continuously after every run. I think it is beacuse of memory leakage. Can you please provide pointers for troubleshooting?
Thanks,
Priya
Created 12-09-2018 08:27 PM
Hello Priya,
Thanks for posting your query.
I see you have reported your spark application memory usage is getting increased on very run, and you suspect it is because of memory leakage
Could you please share where exactly (Driver,Executor) you are observing memory leakage
This will help us to capture certain diagnostic information
Created 12-13-2018 03:27 AM
Created 12-14-2018 08:09 AM
Hello Priya,
I see from your initial thread that you are seeing Memory leaks on your application. Could you please help us with more details
Like, these messages which you are seeing as a side effect of your GC or memory leak ?
Basically, the error denotes that the zookeeper client connection is getting timed out.
Also, please look for any OutOfMemory or GC Overhead messages or please check from Zookeeper server side as well
Created 12-16-2018 11:06 PM