- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
hdfs-audit.log disk space consumption
Created on 08-29-2016 12:49 PM - edited 09-16-2022 03:37 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Been using CDH 5.3.1 and have been running into an issue where HDFS audit logging is consuming over 5GB an hour. This level of logging is unsustainable. How do I go about either turning off audit logging OR update the system so that it only retains say 3 or so audit logs?
Created 08-31-2016 12:20 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
login to cloudera manager => select Hdfs => Configuration => click on log menu option (left bottom)
Here are the properties you may need to update :
1) Maximum Audit Log File Size => check the size you want to set
2) Number of Audit Logs to Retain => Number of backup file you want to retain.
Thanks,
Khirod
Created 08-31-2016 12:20 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
login to cloudera manager => select Hdfs => Configuration => click on log menu option (left bottom)
Here are the properties you may need to update :
1) Maximum Audit Log File Size => check the size you want to set
2) Number of Audit Logs to Retain => Number of backup file you want to retain.
Thanks,
Khirod
Created 09-01-2016 09:12 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Requires Cloudera Enterprise Licenses - kind of silly to require a paid subscription to be able to better manage the audit logs. Sounds like I'll just have to set up a cron job that prunes these logs every 15 minutes.
