Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

YARN/MR2 there are free vcores and mem, but all apps are deadlocked.

YARN/MR2 there are free vcores and mem, but all apps are deadlocked.

Expert Contributor

Hi, I'm still trying to make YARN/MR2 work. I have total 72 vcores and 72GB ram

ResourceManager says that 22 GB and 10 Vcores are occupied.

And there are still a lot of resources.

I've set running apps limit ot 5. There are 5 running apps and they are all waiting for someting... Usually each app runs for 5-10 minutes.

 

Why they they are not finished? How can i debug it? I start all jobs  using oozie. 

1 REPLY 1

Re: YARN/MR2 there are free vcores and mem, but all apps are deadlocked.

Master Guru
If you use Oozie, you may need to double your maxRunningApps settings, as Oozie utilises a Launcher Job to then run actual jobs. If 5 Oozie jobs get run, you will run into a jammed situation where none of them would be able to submit any new applications cause of the maxApps=5 limitation applied.

The most ideal solution to such a scenario is to ensure Oozie jobs go to different queues as opposed to their subsequently submitted jobs, and each of these queues have differing maxRunningApplication limits applied on them.