Support Questions

Find answers, ask questions, and share your expertise

hdfs-audit.log disk space consumption

avatar
New Contributor

Been using CDH 5.3.1 and have been running into an issue where HDFS audit logging is consuming over 5GB an hour.  This level of logging is unsustainable.  How do I go about either turning off audit logging OR update the system so that it only retains say 3 or so audit logs?  

1 ACCEPTED SOLUTION

avatar
Contributor

login to cloudera manager => select Hdfs => Configuration => click on log menu option (left bottom)

 

Here are the properties you may need to update :

 

 1)  Maximum Audit Log File Size => check the size you want to set

 

 2)  Number of Audit Logs to Retain  => Number of backup file you want to retain.

 

Thanks,

Khirod

View solution in original post

2 REPLIES 2

avatar
Contributor

login to cloudera manager => select Hdfs => Configuration => click on log menu option (left bottom)

 

Here are the properties you may need to update :

 

 1)  Maximum Audit Log File Size => check the size you want to set

 

 2)  Number of Audit Logs to Retain  => Number of backup file you want to retain.

 

Thanks,

Khirod

avatar
New Contributor

Requires Cloudera Enterprise Licenses - kind of silly to require a paid subscription to be able to better manage the audit logs.  Sounds like I'll just have to set up a cron job that prunes these logs every 15 minutes.