Reply
Expert Contributor
Posts: 162
Registered: ‎07-29-2013

YARN/MR2 there are free vcores and mem, but all apps are deadlocked.

Hi, I'm still trying to make YARN/MR2 work. I have total 72 vcores and 72GB ram

ResourceManager says that 22 GB and 10 Vcores are occupied.

And there are still a lot of resources.

I've set running apps limit ot 5. There are 5 running apps and they are all waiting for someting... Usually each app runs for 5-10 minutes.

 

Why they they are not finished? How can i debug it? I start all jobs  using oozie. 

Posts: 1,892
Kudos: 431
Solutions: 302
Registered: ‎07-31-2013

Re: YARN/MR2 there are free vcores and mem, but all apps are deadlocked.

If you use Oozie, you may need to double your maxRunningApps settings, as Oozie utilises a Launcher Job to then run actual jobs. If 5 Oozie jobs get run, you will run into a jammed situation where none of them would be able to submit any new applications cause of the maxApps=5 limitation applied.

The most ideal solution to such a scenario is to ensure Oozie jobs go to different queues as opposed to their subsequently submitted jobs, and each of these queues have differing maxRunningApplication limits applied on them.
Announcements