https://community.cloudera.com/t5/Archives-of-Support-Questions/What-is-the-releatiohship-between-yarn-container-and-Block/m-p/105897#M33477 <P>I mean a bit relation is there. Normally MapReduce will create one Map task for every block. ( Unless small split merge is switched on ). And one map task will run in one container. So half the block size means twice the number of containers running. ( Again not always true since Pig/Tez merge small blocks together using something called the CombineFileInputFormat) </P> Thu, 30 Jun 2016 17:36:06 GMT bleonhardi 2016-06-30T17:36:06Z https://community.cloudera.com/t5/Archives-of-Support-Questions/What-is-the-releatiohship-between-yarn-container-and-Block/m-p/105894#M33474 <P>What is the releatiohship between yarn container and Block size in hdfs</P> Thu, 30 Jun 2016 16:19:40 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/What-is-the-releatiohship-between-yarn-container-and-Block/m-p/105894#M33474 ansarifah 2016-06-30T16:19:40Z https://community.cloudera.com/t5/Archives-of-Support-Questions/What-is-the-releatiohship-between-yarn-container-and-Block/m-p/105895#M33475 <P><A rel="user" href="https://community.cloudera.com/users/3331/ansarifah.html" nodeid="3331">@ANSARI FAHEEM AHMED</A>yarn container is a collection of physical resources like CPU,memory and disk.while HDFS block size is chunk on file system where actual read and write happen.</P> Thu, 30 Jun 2016 16:30:56 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/What-is-the-releatiohship-between-yarn-container-and-Block/m-p/105895#M33475 rajkumar_singh 2016-06-30T16:30:56Z https://community.cloudera.com/t5/Archives-of-Support-Questions/What-is-the-releatiohship-between-yarn-container-and-Block/m-p/105896#M33476 <P><A rel="user" href="https://community.cloudera.com/users/8919/rajkumarsingh.html" nodeid="8919">@Rajkumar Singh</A>: Yes, means no relation.</P> Thu, 30 Jun 2016 16:38:09 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/What-is-the-releatiohship-between-yarn-container-and-Block/m-p/105896#M33476 ansarifah 2016-06-30T16:38:09Z https://community.cloudera.com/t5/Archives-of-Support-Questions/What-is-the-releatiohship-between-yarn-container-and-Block/m-p/105897#M33477 <P>I mean a bit relation is there. Normally MapReduce will create one Map task for every block. ( Unless small split merge is switched on ). And one map task will run in one container. So half the block size means twice the number of containers running. ( Again not always true since Pig/Tez merge small blocks together using something called the CombineFileInputFormat) </P> Thu, 30 Jun 2016 17:36:06 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/What-is-the-releatiohship-between-yarn-container-and-Block/m-p/105897#M33477 bleonhardi 2016-06-30T17:36:06Z