question Re: Yarn and submitting MapReduce jobs in Support Questions

Yarn and submitting MapReduce jobs

mikopp — Fri, 16 Sep 2022 08:46:48 GMT

Hi,

I used Cloudera Manager to setup a Cloudera Cluster in EC2 and have it setup to run Yarn instead of MRv1. However whenever I submit any jobs, the job gets accepted and is listed in the Resource Manager Web UI as accepted with final status undefined and tracking undefined. The job never starts I can find no errors whatsoever in any logs. Does anybody have an Idea why this could be? I suspect that the resource manager decides that there aren't the necessary resources available to run the job, jowever I have the tasks configured to run with 512 MB and that is definitely available...

Thanks!

Mike

Re: Yarn and submitting MapReduce jobs

dvohra — Wed, 14 Aug 2013 14:17:08 GMT

Is the cluster created as explained in http://blog.cloudera.com/blog/2013/03/how-to-create-a-cdh-cluster-on-amazon-ec2-via-cloudera-manager/

Re: Yarn and submitting MapReduce jobs

Harsh J — Sun, 18 Aug 2013 20:35:31 GMT

@mikopp wrote:
I suspect that the resource manager decides that there aren't the necessary resources available to run the job, jowever I have the tasks configured to run with 512 MB and that is definitely available...

Your suspicion is mostly true given the described symptoms. The way RM sees resources is not tied to the hardware, but is instead tied to how much an NM publishes per its configuration of yarn.nodemanager.resource.memory-mb.

Try to resubmit after lowering the values of the following properties (Defaults indicated):

mapreduce.map.memory.mb (1024 MB)
mapreduce.reduce.memory.mb (1024 MB)
yarn.app.mapreduce.am.resource.mb (1536 MB)

Re: Yarn and submitting MapReduce jobs

mikopp — Mon, 19 Aug 2013 07:29:01 GMT

Thanks Harsh,

That was the tip I needed. I had already changed the map and reduce memory (and pretty much everything else) but I didn't know about the yarn.app.mapreduce.am.resource.mb and for some reason that was messed up.

The ec2 setup of CFM put the 512 in my data nodes and 1.5 G in my node that ran all the master services. So the other way around. After giving the worker nodes 2.5 G and reducing the master to 512 it started running.

I used the CFM to set things up, so this might be a bug there.

Thanks again!

Best

Mike

Re: Yarn and submitting MapReduce jobs

gp1s — Thu, 09 Jan 2014 14:43:05 GMT

I am also facing the similar issue. Let me see if this solution works.

Re: Yarn and submitting MapReduce jobs

gp1s — Thu, 09 Jan 2014 14:43:51 GMT

I have successfully enabled the YARN framework in CDH 4.5 but not able to execute a MR appplication.
Please find the attached doc.

Am i missing something ?

I can easily do the same on Apache Hadoop 2.0 using numerous blogs and forums but not on highly customized CDH 4.5.

Re: Yarn and submitting MapReduce jobs

Raj_1111 — Fri, 14 Nov 2014 04:29:23 GMT

Hello Guys,

I have created EC2 Cluster and installed CDH 5(Just did as said in Cloudera website), but whenever i am starting my cloudera manager, the PU usuage is always showing as 100% . And none od Map reduce job are running, when i run the same, the job are not really running and stops at below step.

14/11/13 23:17:18 INFO mapreduce.Job: Running job: job_1415938229059_0001

When i am checking the Final Status, it says undefined, I beleive, it might be the issue with some configuration.

Any Pointers.

--Vijay

Re: Yarn and submitting MapReduce jobs

Raj_1111 — Fri, 14 Nov 2014 04:54:10 GMT

i am using m3.large...is its a Problem?

Re: Yarn and submitting MapReduce jobs

Raj_1111 — Thu, 20 Nov 2014 04:47:42 GMT

Fixed the same. Problem with the Yarn Setting. Set the default values via Dyanmic Resource Pools.

Re: Yarn and submitting MapReduce jobs

SANKARA TELUKUTLA — Wed, 03 Jun 2015 00:54:10 GMT

Lowering the params didn't work for me. Is there any other information I can verify?

-Shankar