Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Few executers running on Yarn never stop processing and app freeze down

Highlighted

Few executers running on Yarn never stop processing and app freeze down

New Contributor

I have a job which is calling a spring boot application end points and getting some data from it.

I have roughly 400,000,00 data points which are being sent to end point using Map function. 

I am running application on Yarn and I have assigned 300+ executors each having 8 gigs memory. 

Everything runs smoothly, I can see requests coming and going on spring boot application. 

All executors finish their job in time but a couple of them ( mostly 1 or sometimes 2-5 ) keep on waiting and doing absolutely nothing. And that last step never finishes. 

Their thread dump shows they are waiting for some threads. 

I have tried to turn on dynamic allocation but still having the same problem. 

 

What could be the issue?

 

 

1 REPLY 1

Re: Few executers running on Yarn never stop processing and app freeze down

New Contributor

InkedMapMatcherLastContainerRunning_LI.jpglast executer remaining and never finishingMapMatcherWaiting.PNGThread dump of last remaining executer

Don't have an account?
Coming from Hortonworks? Activate your account here