Archives of Support Questions (Read Only)

This is an archived board for historical reference. Information and links may no longer be available or relevant
Announcements
This board is archived and read-only for historical reference. To ask a new question, please post a new topic on the appropriate active board.

hdfs-audit.log disk space consumption

avatar
New Contributor

Been using CDH 5.3.1 and have been running into an issue where HDFS audit logging is consuming over 5GB an hour.  This level of logging is unsustainable.  How do I go about either turning off audit logging OR update the system so that it only retains say 3 or so audit logs?  

1 ACCEPTED SOLUTION

avatar
Contributor

login to cloudera manager => select Hdfs => Configuration => click on log menu option (left bottom)

 

Here are the properties you may need to update :

 

 1)  Maximum Audit Log File Size => check the size you want to set

 

 2)  Number of Audit Logs to Retain  => Number of backup file you want to retain.

 

Thanks,

Khirod

View solution in original post

2 REPLIES 2

avatar
Contributor

login to cloudera manager => select Hdfs => Configuration => click on log menu option (left bottom)

 

Here are the properties you may need to update :

 

 1)  Maximum Audit Log File Size => check the size you want to set

 

 2)  Number of Audit Logs to Retain  => Number of backup file you want to retain.

 

Thanks,

Khirod

avatar
New Contributor

Requires Cloudera Enterprise Licenses - kind of silly to require a paid subscription to be able to better manage the audit logs.  Sounds like I'll just have to set up a cron job that prunes these logs every 15 minutes.