About vsivalingam

rajkumar_singh · ‎06-19-2016

normally mapper dont fail with OOM and 8192M is pretty good, I suspect that if you have some big records while reading from csv, are you doing some memory intensive operation inside mapper. could you please share the task log for this attempt attempt_1466342436828_0001_m_000008_2

Former Member · ‎06-13-2016

In that case the best option will be to switch to "ROLLINGFILE" as it has the capability to roll log4j.rootLogger=INFO, ROLLINGFILE log4j.appender.ROLLINGFILE.File=${zookeeper.log.dir}/zookeeper.log log4j.appender.ROLLINGFILE.MaxFileSize=10MB log4j.appender.ROLLINGFILE.MaxBackupIndex=10

vsivalingam · ‎06-13-2016

@nmaillardWhen the process starts I see the YARN memory as 100% on the Ambari homepage.How do we find the time taken to get an Application master.

vsivalingam · ‎05-26-2016

@Ravi MutyalaThere is no job running currently. So I believe the files can be removed manually. But does this happen with all failed jobs? Will it be a manual process every time to remove such kind of leftover files or any process is available to remove these files periodically?

Online	Offline
Last Visited	‎06-19-2016 02:39 PM

Member Since	‎05-26-2016 10:31 AM
Last Visited	‎06-19-2016 02:39 PM
Posts	17

Cloudera Community

Re: Mapreduce - GC overhead limit exceeded

Re: Zookeeper log file not rotated

Re: Mapreduce Job -Taking too long to complete

Re: Manage YARN local log-dirs space