https://community.cloudera.com/t5/Archives-of-Support-Questions/I-have-4-data-nodes-and-In-one-of-data-node-yarn-container/m-p/166635#M41595 <P>I have a container logs configured as below</P><P>yarn.nodemanager.log-dirs:</P><P>/data1/hadoop/yarn/log,/data2/hadoop/yarn/log,/data3/hadoop/yarn/log,/data4/hadoop/yarn/log,/data5/hadoop/yarn/log,/data6/hadoop/yarn/log,/data7/hadoop/yarn/log,/data8/hadoop/yarn/log,/data9/hadoop/yarn/log,/data10/hadoop/yarn/log,/data11/hadoop/yarn/log,/data12/hadoop/yarn/log</P><P>/data9/hadoop/yarn/log file system in one of the data node is full, all logs are older than 1 year</P><P>Can i deleted these logs ? </P> Fri, 23 Sep 2016 15:07:24 GMT g_rao9704 2016-09-23T15:07:24Z https://community.cloudera.com/t5/Archives-of-Support-Questions/I-have-4-data-nodes-and-In-one-of-data-node-yarn-container/m-p/166635#M41595 <P>I have a container logs configured as below</P><P>yarn.nodemanager.log-dirs:</P><P>/data1/hadoop/yarn/log,/data2/hadoop/yarn/log,/data3/hadoop/yarn/log,/data4/hadoop/yarn/log,/data5/hadoop/yarn/log,/data6/hadoop/yarn/log,/data7/hadoop/yarn/log,/data8/hadoop/yarn/log,/data9/hadoop/yarn/log,/data10/hadoop/yarn/log,/data11/hadoop/yarn/log,/data12/hadoop/yarn/log</P><P>/data9/hadoop/yarn/log file system in one of the data node is full, all logs are older than 1 year</P><P>Can i deleted these logs ? </P> Fri, 23 Sep 2016 15:07:24 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/I-have-4-data-nodes-and-In-one-of-data-node-yarn-container/m-p/166635#M41595 g_rao9704 2016-09-23T15:07:24Z https://community.cloudera.com/t5/Archives-of-Support-Questions/I-have-4-data-nodes-and-In-one-of-data-node-yarn-container/m-p/166636#M41596 <P>Hi <A rel="user" href="https://community.cloudera.com/users/10953/grao9704.html" nodeid="10953">@rama</A>,</P><P>You can delete the old container logs. If yarn.nodemanager.log-dir is full no new containers will start on that node.</P><P>See also </P><P>yarn.nodemanager.disk-health-checker.min-healthy-disks </P><P>yarn.nodemanager.disk-health-checker.max-disk-utilization-per-disk-percentage</P><P>yarn.nodemanager.disk-health-checker.min-free-space-per-disk-mb</P><P>/Best regards, Mats</P> Fri, 23 Sep 2016 15:51:27 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/I-have-4-data-nodes-and-In-one-of-data-node-yarn-container/m-p/166636#M41596 mjohansson 2016-09-23T15:51:27Z https://community.cloudera.com/t5/Archives-of-Support-Questions/I-have-4-data-nodes-and-In-one-of-data-node-yarn-container/m-p/166637#M41597 <P>Thanks@<A href="https://community.hortonworks.com/users/210/mjohansson.html">Mats Johansson</A></P><P>I have a another basic question is that, what is this directory each of my Node node having 12 directories,can i increase this.and how the logs are distributed between these 4 nodes/12 directories? </P> Fri, 23 Sep 2016 16:20:50 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/I-have-4-data-nodes-and-In-one-of-data-node-yarn-container/m-p/166637#M41597 g_rao9704 2016-09-23T16:20:50Z https://community.cloudera.com/t5/Archives-of-Support-Questions/I-have-4-data-nodes-and-In-one-of-data-node-yarn-container/m-p/166638#M41598 <P> <A rel="user" href="https://community.cloudera.com/users/10953/grao9704.html" nodeid="10953">@rama</A> These directories are used by yarn for job logs. There are similar directories used for localization, the yarn-local dirs. They are not distributed so much as used when containers are allocated on that node. They should get cleaned up when jobs complete but can leave orphaned files in the event of a Resource Manager restart or a Node Manager restart. The directories are configured via yarn and it is a comma separated list of locations so you can add additional mounts/directories but they will apply to all node managers managed by Yarn. Hope this helps.</P> Fri, 23 Sep 2016 21:40:37 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/I-have-4-data-nodes-and-In-one-of-data-node-yarn-container/m-p/166638#M41598 iroberts 2016-09-23T21:40:37Z