https://community.cloudera.com/t5/Archives-of-Support-Questions/if-the-scheduler-is-FIFO-how-the-size-of-container-is-decide/m-p/182084#M58670 <P>in FIFO scheduler only one job is allowed to run at a time. so the resource of a node will further divides in container or not ? if yes then what is advantage of it as no other job is going to execute at same time?</P> Fri, 31 Mar 2017 13:16:00 GMT heta_desai 2017-03-31T13:16:00Z https://community.cloudera.com/t5/Archives-of-Support-Questions/if-the-scheduler-is-FIFO-how-the-size-of-container-is-decide/m-p/182084#M58670 <P>in FIFO scheduler only one job is allowed to run at a time. so the resource of a node will further divides in container or not ? if yes then what is advantage of it as no other job is going to execute at same time?</P> Fri, 31 Mar 2017 13:16:00 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/if-the-scheduler-is-FIFO-how-the-size-of-container-is-decide/m-p/182084#M58670 heta_desai 2017-03-31T13:16:00Z https://community.cloudera.com/t5/Archives-of-Support-Questions/if-the-scheduler-is-FIFO-how-the-size-of-container-is-decide/m-p/182085#M58671 <P>FIFO was the default scheduler in Hadoop1, when you deploy Apache Hadoop vanilla version. It is not used in production, as only 1 job can run. But 1 job can have many containers and each node in the cluster can have few of them running. </P><P>Size of the container has nothing to do with how many jobs are running on a cluster. It is decided by the map/reduce memory which asks for a container from YARN, which should be a multiple of yarn minimum allocation. </P><P>There are lot of details here, but keeping it simple the size of container is not related to the number of containers. Yes, for mathematical calculations and to find how many containers can run on a node, we say that the number is equal to total memory avail for yarn/container memory.</P><P>Size of a container is decided based on the request, whether it is map or reduce or spark task container etc.</P> Fri, 31 Mar 2017 14:11:23 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/if-the-scheduler-is-FIFO-how-the-size-of-container-is-decide/m-p/182085#M58671 trainings 2017-03-31T14:11:23Z https://community.cloudera.com/t5/Archives-of-Support-Questions/if-the-scheduler-is-FIFO-how-the-size-of-container-is-decide/m-p/182086#M58672 <P>Thank you.!</P> Fri, 31 Mar 2017 16:41:57 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/if-the-scheduler-is-FIFO-how-the-size-of-container-is-decide/m-p/182086#M58672 heta_desai 2017-03-31T16:41:57Z