09-30-2014 12:34 AM
I would like to change the logging configuration of the fairsheduler but I can't find where it is.
Currently it seems to log to /var/log/hadoop-yarn/fairscheduler/... with 10 files each of 600M.
Can you point me in the right direction?
09-30-2014 01:55 AM
I just found out myself that this configuration is hardcoded in the org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairSchedulerEventLog.init() method...
So as far as I can see, it is not possible to control this logging in CDH4.4.
Cleaning up these files have to be done as an external process.