Created on 08-29-2016 12:49 PM - edited 09-16-2022 03:37 AM
Been using CDH 5.3.1 and have been running into an issue where HDFS audit logging is consuming over 5GB an hour. This level of logging is unsustainable. How do I go about either turning off audit logging OR update the system so that it only retains say 3 or so audit logs?
Created 08-31-2016 12:20 AM
login to cloudera manager => select Hdfs => Configuration => click on log menu option (left bottom)
Here are the properties you may need to update :
1) Maximum Audit Log File Size => check the size you want to set
2) Number of Audit Logs to Retain => Number of backup file you want to retain.
Thanks,
Khirod
Created 08-31-2016 12:20 AM
login to cloudera manager => select Hdfs => Configuration => click on log menu option (left bottom)
Here are the properties you may need to update :
1) Maximum Audit Log File Size => check the size you want to set
2) Number of Audit Logs to Retain => Number of backup file you want to retain.
Thanks,
Khirod
Created 09-01-2016 09:12 AM
Requires Cloudera Enterprise Licenses - kind of silly to require a paid subscription to be able to better manage the audit logs. Sounds like I'll just have to set up a cron job that prunes these logs every 15 minutes.