I have changed my hadoop-env.sh and advanced log4j using ambari for making change to how hdfs-audit.log is rolled. I have added a new RollingFileAppender configuration in log4j as below, so that i can replace the DailyRollingFileAppender with this one.
Now i am simply overwriting the advanced hadoop-env.sh with the new appender information
-Dhdfs.audit.logger=INFO,DRFAAUDIT with -Dhdfs.audit.logger=INFO,RFAAUDIT
I have not touched the jobsummary logger
But after restarting and monitoring the logs, i find that there is no issue with rolling of hdfs-audit.log. It is successfully rolling after 100MB. However my /var/log/hadoop-yarn/yarn/hadoop-mapreduce.jobsummary.log is not longer getting updated post this change. The log has stopped updating since this change. I don't know how the audit log settings have messed up the mapreduce jobsummary logging.